2018-10-25 12:25:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 12:25:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 12:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:25:37 [DEBUG   ] Got command RPT from MCS: ref #267386
2018-10-25 12:25:37 [DEBUG   ] summary = ERROR
2018-10-25 12:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267386  13 58416 44737041 A  ERRORERROR'
2018-10-25 12:25:37 [DEBUG   ] Got command RPT from MCS: ref #267387
2018-10-25 12:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267387  84 58416 44737042 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:25:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:25:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:25:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:25:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:25:37 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:25:37 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-25 12:25:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 12:26:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 12:26:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 12:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:26:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:26:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:26:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:26:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:26:37 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:26:37 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-25 12:26:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 12:27:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:27:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:27:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:27:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:27:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:27:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:27:37 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:27:37 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-25 12:27:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 12:28:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 12:28:09 [DEBUG   ] Got command RPT from MCS: ref #267403
2018-10-25 12:28:09 [DEBUG   ] summary = ERROR
2018-10-25 12:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267403  13 58416 44889469 A  ERRORERROR'
2018-10-25 12:28:09 [DEBUG   ] Got command RPT from MCS: ref #267404
2018-10-25 12:28:09 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267404  84 58416 44889661 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:28:09 [DEBUG   ] Got command RPT from MCS: ref #267405
2018-10-25 12:28:09 [DEBUG   ] summary = ERROR
2018-10-25 12:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267405  13 58416 44889865 A  ERRORERROR'
2018-10-25 12:28:10 [DEBUG   ] Got command RPT from MCS: ref #267406
2018-10-25 12:28:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267406  84 58416 44890069 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:28:10 [DEBUG   ] Got command RPT from MCS: ref #267407
2018-10-25 12:28:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267407  12 58416 44890273 A  ERRORB–™š'
2018-10-25 12:28:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-25 12:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:28:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 12:28:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:28:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:28:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:28:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:28:37 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:28:37 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-25 12:28:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:29:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:29:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 12:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:29:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:29:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:29:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:29:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:29:37 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:29:37 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-10-25 12:29:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 12:30:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 12:30:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 12:30:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 12:30:37 [DEBUG   ] Got command RPT from MCS: ref #267412
2018-10-25 12:30:37 [DEBUG   ] summary = ERROR
2018-10-25 12:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267412  13 58416 45037041 A  ERRORERROR'
2018-10-25 12:30:37 [DEBUG   ] Got command RPT from MCS: ref #267413
2018-10-25 12:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267413  84 58416 45037042 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:30:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:30:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:30:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:30:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:30:37 [WARNING ] (13, 1, 'bot')
2018-10-25 12:30:37 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:30:37 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-10-25 12:30:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 12:31:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:31:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 12:31:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 12:31:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:31:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:31:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:31:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:31:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:31:38 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-25 12:31:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 12:32:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:32:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:32:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 12:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-25 12:32:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:32:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:32:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:32:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:32:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:32:38 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-25 12:32:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:33:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 12:33:09 [DEBUG   ] Got command RPT from MCS: ref #267435
2018-10-25 12:33:09 [DEBUG   ] summary = ERROR
2018-10-25 12:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267435  13 58416 45189553 A  ERRORERROR'
2018-10-25 12:33:09 [DEBUG   ] Got command RPT from MCS: ref #267436
2018-10-25 12:33:09 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267436  84 58416 45189745 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:33:09 [DEBUG   ] Got command RPT from MCS: ref #267437
2018-10-25 12:33:09 [DEBUG   ] summary = ERROR
2018-10-25 12:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267437  13 58416 45189949 A  ERRORERROR'
2018-10-25 12:33:10 [DEBUG   ] Got command RPT from MCS: ref #267439
2018-10-25 12:33:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267439  84 58416 45190153 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:33:10 [DEBUG   ] Got command RPT from MCS: ref #267440
2018-10-25 12:33:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267440  12 58416 45190357 A  ERRORB—™š'
2018-10-25 12:33:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:33:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:33:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:33:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:33:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:33:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:33:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:33:38 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-25 12:33:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 12:34:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:34:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 12:34:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:34:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:34:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:34:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:34:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:34:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:34:38 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-10-25 12:34:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 12:35:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 12:35:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 12:35:37 [DEBUG   ] Got command RPT from MCS: ref #267449
2018-10-25 12:35:37 [DEBUG   ] summary = ERROR
2018-10-25 12:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267449  13 58416 45337042 A  ERRORERROR'
2018-10-25 12:35:37 [DEBUG   ] Got command RPT from MCS: ref #267450
2018-10-25 12:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267450  84 58416 45337042 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:35:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:35:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:35:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:35:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:35:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:35:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:35:38 [DEBUG   ] Finished updating board flags in 1.925 seconds
2018-10-25 12:35:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 12:36:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 12:36:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 12:36:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:36:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:36:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:36:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:36:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:36:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:36:38 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-25 12:36:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 12:37:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:37:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:37:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 12:37:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:37:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:37:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:37:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:37:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:37:38 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-25 12:37:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 12:38:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 12:38:09 [DEBUG   ] Got command RPT from MCS: ref #267470
2018-10-25 12:38:09 [DEBUG   ] summary = ERROR
2018-10-25 12:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267470  13 58416 45489637 A  ERRORERROR'
2018-10-25 12:38:09 [DEBUG   ] Got command RPT from MCS: ref #267471
2018-10-25 12:38:09 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267471  84 58416 45489829 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:38:10 [DEBUG   ] Got command RPT from MCS: ref #267472
2018-10-25 12:38:10 [DEBUG   ] summary = ERROR
2018-10-25 12:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267472  13 58416 45490033 A  ERRORERROR'
2018-10-25 12:38:10 [DEBUG   ] Got command RPT from MCS: ref #267473
2018-10-25 12:38:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267473  84 58416 45490237 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:38:10 [DEBUG   ] Got command RPT from MCS: ref #267474
2018-10-25 12:38:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267474  12 58416 45490441 A  ERRORB—™š'
2018-10-25 12:38:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:38:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:38:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:38:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:38:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:38:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:38:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:38:38 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-25 12:38:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:39:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:39:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 12:39:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:39:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 12:39:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:39:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:39:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:39:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:39:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:39:38 [DEBUG   ] Finished updating board flags in 1.669 seconds
2018-10-25 12:39:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:40:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:40:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:40:37 [DEBUG   ] Got command RPT from MCS: ref #267479
2018-10-25 12:40:37 [DEBUG   ] summary = ERROR
2018-10-25 12:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267479  13 58416 45637049 A  ERRORERROR'
2018-10-25 12:40:37 [DEBUG   ] Got command RPT from MCS: ref #267480
2018-10-25 12:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267480  84 58416 45637050 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:40:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:40:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:40:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:40:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:40:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:40:38 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-25 12:40:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 12:41:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 12:41:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 12:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:41:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:41:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:41:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:41:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:41:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:41:38 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-25 12:41:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 12:42:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 12:42:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 12:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:42:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:42:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:42:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:42:38 [WARNING ] (13, 1, 'bot')
2018-10-25 12:42:38 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:42:38 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-10-25 12:42:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 12:43:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 12:43:09 [DEBUG   ] Got command RPT from MCS: ref #267498
2018-10-25 12:43:09 [DEBUG   ] summary = ERROR
2018-10-25 12:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267498  13 58416 45789717 A  ERRORERROR'
2018-10-25 12:43:09 [DEBUG   ] Got command RPT from MCS: ref #267499
2018-10-25 12:43:09 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267499  84 58416 45789921 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:43:10 [DEBUG   ] Got command RPT from MCS: ref #267500
2018-10-25 12:43:10 [DEBUG   ] summary = ERROR
2018-10-25 12:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267500  13 58416 45790125 A  ERRORERROR'
2018-10-25 12:43:10 [DEBUG   ] Got command RPT from MCS: ref #267502
2018-10-25 12:43:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267502  84 58416 45790317 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:43:10 [DEBUG   ] Got command RPT from MCS: ref #267503
2018-10-25 12:43:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267503  12 58416 45790521 A  ERRORB•™š'
2018-10-25 12:43:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 12:43:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:43:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 12:43:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:43:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:43:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:43:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:43:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:43:39 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-10-25 12:43:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 12:44:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 12:44:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 12:44:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:44:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:44:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:44:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:44:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:44:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:44:39 [DEBUG   ] Finished updating board flags in 2.163 seconds
2018-10-25 12:44:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:45:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 12:45:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:45:37 [DEBUG   ] Got command RPT from MCS: ref #267512
2018-10-25 12:45:37 [DEBUG   ] summary = ERROR
2018-10-25 12:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267512  13 58416 45937045 A  ERRORERROR'
2018-10-25 12:45:37 [DEBUG   ] Got command RPT from MCS: ref #267513
2018-10-25 12:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267513  84 58416 45937046 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:45:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:45:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:45:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:45:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:45:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:45:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:45:39 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-25 12:45:45 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 12:46:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 12:46:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 12:46:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:46:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:46:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:46:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:46:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:46:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:46:39 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-10-25 12:46:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 12:47:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 12:47:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 12:47:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:47:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:47:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:47:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:47:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:47:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:47:39 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-25 12:47:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 12:48:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 12:48:09 [DEBUG   ] Got command RPT from MCS: ref #267533
2018-10-25 12:48:09 [DEBUG   ] summary = ERROR
2018-10-25 12:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267533  13 58416 46089809 A  ERRORERROR'
2018-10-25 12:48:10 [DEBUG   ] Got command RPT from MCS: ref #267534
2018-10-25 12:48:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267534  84 58416 46090001 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:48:10 [DEBUG   ] Got command RPT from MCS: ref #267535
2018-10-25 12:48:10 [DEBUG   ] summary = ERROR
2018-10-25 12:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267535  13 58416 46090205 A  ERRORERROR'
2018-10-25 12:48:10 [DEBUG   ] Got command RPT from MCS: ref #267536
2018-10-25 12:48:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267536  84 58416 46090409 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:48:10 [DEBUG   ] Got command RPT from MCS: ref #267537
2018-10-25 12:48:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267537  12 58416 46090613 A  ERRORB—™š'
2018-10-25 12:48:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 12:48:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:48:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:48:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:48:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:48:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:48:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:48:39 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-25 12:48:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 12:49:06 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-25 12:49:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 12:49:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:49:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:49:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:49:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:49:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:49:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:49:39 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-25 12:49:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 12:50:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 12:50:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 12:50:37 [DEBUG   ] Got command RPT from MCS: ref #267542
2018-10-25 12:50:37 [DEBUG   ] summary = ERROR
2018-10-25 12:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267542  13 58416 46237049 A  ERRORERROR'
2018-10-25 12:50:37 [DEBUG   ] Got command RPT from MCS: ref #267543
2018-10-25 12:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267543  84 58416 46237050 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:50:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:50:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:50:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:50:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:50:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:50:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:50:39 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-10-25 12:50:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 12:51:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:51:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 12:51:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:51:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:51:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:51:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:51:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:51:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:51:39 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-25 12:51:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 12:52:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 12:52:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:52:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:52:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:52:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:52:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:52:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:52:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:52:39 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-25 12:52:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 12:53:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 12:53:09 [DEBUG   ] Got command RPT from MCS: ref #267565
2018-10-25 12:53:09 [DEBUG   ] summary = ERROR
2018-10-25 12:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267565  13 58416 46389893 A  ERRORERROR'
2018-10-25 12:53:10 [DEBUG   ] Got command RPT from MCS: ref #267566
2018-10-25 12:53:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267566  84 58416 46390085 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:53:10 [DEBUG   ] Got command RPT from MCS: ref #267567
2018-10-25 12:53:10 [DEBUG   ] summary = ERROR
2018-10-25 12:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267567  13 58416 46390289 A  ERRORERROR'
2018-10-25 12:53:10 [DEBUG   ] Got command RPT from MCS: ref #267569
2018-10-25 12:53:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267569  84 58416 46390493 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:53:10 [DEBUG   ] Got command RPT from MCS: ref #267570
2018-10-25 12:53:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267570  12 58416 46390697 A  ERRORB—™š'
2018-10-25 12:53:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 12:53:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:53:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:53:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:53:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:53:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:53:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:53:39 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-25 12:53:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 12:54:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 12:54:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 12:54:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:54:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:54:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:54:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:54:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:54:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:54:39 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-25 12:54:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 12:55:07 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-10-25 12:55:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 12:55:37 [DEBUG   ] Got command RPT from MCS: ref #267579
2018-10-25 12:55:37 [DEBUG   ] summary = ERROR
2018-10-25 12:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267579  13 58416 46537049 A  ERRORERROR'
2018-10-25 12:55:37 [DEBUG   ] Got command RPT from MCS: ref #267580
2018-10-25 12:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267580  84 58416 46537050 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:55:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:55:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:55:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:55:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:55:39 [WARNING ] (13, 1, 'bot')
2018-10-25 12:55:39 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:55:39 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-25 12:55:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:56:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 12:56:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 12:56:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:56:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:56:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:56:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:56:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:56:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:56:40 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-10-25 12:56:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 12:57:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:57:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 12:57:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:57:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:57:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:57:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:57:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:57:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:57:40 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-25 12:57:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 12:58:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 12:58:09 [DEBUG   ] Got command RPT from MCS: ref #267596
2018-10-25 12:58:09 [DEBUG   ] summary = ERROR
2018-10-25 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267596  13 58416 46689973 A  ERRORERROR'
2018-10-25 12:58:10 [DEBUG   ] Got command RPT from MCS: ref #267597
2018-10-25 12:58:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267597  84 58416 46690177 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:58:10 [DEBUG   ] Got command RPT from MCS: ref #267598
2018-10-25 12:58:10 [DEBUG   ] summary = ERROR
2018-10-25 12:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267598  13 58416 46690381 A  ERRORERROR'
2018-10-25 12:58:10 [DEBUG   ] Got command RPT from MCS: ref #267599
2018-10-25 12:58:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 12:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267599  84 58416 46690585 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 12:58:10 [DEBUG   ] Got command RPT from MCS: ref #267600
2018-10-25 12:58:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 12:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267600  12 58416 46690777 A  ERRORB–™š'
2018-10-25 12:58:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 12:58:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:58:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:58:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:58:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:58:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:58:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:58:40 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-10-25 12:58:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 12:59:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 12:59:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 12:59:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 12:59:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:59:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:59:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:59:40 [WARNING ] (13, 1, 'bot')
2018-10-25 12:59:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 12:59:40 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-25 12:59:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:00:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:00:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:00:37 [DEBUG   ] Got command RPT from MCS: ref #267605
2018-10-25 13:00:37 [DEBUG   ] summary = ERROR
2018-10-25 13:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267605  13 58416 46837045 A  ERRORERROR'
2018-10-25 13:00:37 [DEBUG   ] Got command RPT from MCS: ref #267606
2018-10-25 13:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267606  84 58416 46837046 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:00:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:00:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:00:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:00:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:00:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:00:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:00:40 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-10-25 13:00:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:01:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:01:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:01:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:01:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:01:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:01:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:01:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:01:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:01:40 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-25 13:01:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:02:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:02:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:02:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:02:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:02:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:02:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:02:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:02:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:02:40 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-25 13:02:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:03:08 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-25 13:03:10 [DEBUG   ] Got command RPT from MCS: ref #267628
2018-10-25 13:03:10 [DEBUG   ] summary = ERROR
2018-10-25 13:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267628  13 58416 46990065 A  ERRORERROR'
2018-10-25 13:03:10 [DEBUG   ] Got command RPT from MCS: ref #267629
2018-10-25 13:03:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267629  84 58416 46990257 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:03:10 [DEBUG   ] Got command RPT from MCS: ref #267630
2018-10-25 13:03:10 [DEBUG   ] summary = ERROR
2018-10-25 13:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267630  13 58416 46990461 A  ERRORERROR'
2018-10-25 13:03:10 [DEBUG   ] Got command RPT from MCS: ref #267632
2018-10-25 13:03:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267632  84 58416 46990665 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:03:10 [DEBUG   ] Got command RPT from MCS: ref #267634
2018-10-25 13:03:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267634  12 58416 46990869 A  ERRORB–™š'
2018-10-25 13:03:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:03:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:03:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:03:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:03:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:03:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:03:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:03:40 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-10-25 13:03:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:04:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:04:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:04:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:04:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:04:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:04:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:04:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:04:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:04:40 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-25 13:04:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 13:05:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:05:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:05:37 [DEBUG   ] Got command RPT from MCS: ref #267642
2018-10-25 13:05:37 [DEBUG   ] summary = ERROR
2018-10-25 13:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267642  13 58416 47137053 A  ERRORERROR'
2018-10-25 13:05:37 [DEBUG   ] Got command RPT from MCS: ref #267643
2018-10-25 13:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267643  84 58416 47137054 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:05:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:05:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:05:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:05:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:05:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:05:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:05:40 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-25 13:05:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:06:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 13:06:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:06:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:06:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:06:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:06:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:06:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:06:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:06:40 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-25 13:06:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:07:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 13:07:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:07:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:07:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:07:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:07:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:07:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:07:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:07:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:07:40 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-25 13:07:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:08:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:08:10 [DEBUG   ] Got command RPT from MCS: ref #267663
2018-10-25 13:08:10 [DEBUG   ] summary = ERROR
2018-10-25 13:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267663  13 58416 47290149 A  ERRORERROR'
2018-10-25 13:08:10 [DEBUG   ] Got command RPT from MCS: ref #267664
2018-10-25 13:08:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267664  84 58416 47290353 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:08:10 [DEBUG   ] Got command RPT from MCS: ref #267665
2018-10-25 13:08:10 [DEBUG   ] summary = ERROR
2018-10-25 13:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267665  13 58416 47290545 A  ERRORERROR'
2018-10-25 13:08:10 [DEBUG   ] Got command RPT from MCS: ref #267666
2018-10-25 13:08:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267666  84 58416 47290749 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:08:10 [DEBUG   ] Got command RPT from MCS: ref #267667
2018-10-25 13:08:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267667  12 58416 47290953 A  ERRORB—™š'
2018-10-25 13:08:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:08:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:08:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:08:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:08:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:08:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:08:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:08:40 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-10-25 13:08:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:09:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:09:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 13:09:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:09:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:09:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:09:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:09:40 [WARNING ] (13, 1, 'bot')
2018-10-25 13:09:40 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:09:40 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-10-25 13:09:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:10:08 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-25 13:10:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:10:37 [DEBUG   ] Got command RPT from MCS: ref #267672
2018-10-25 13:10:37 [DEBUG   ] summary = ERROR
2018-10-25 13:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267672  13 58416 47437049 A  ERRORERROR'
2018-10-25 13:10:37 [DEBUG   ] Got command RPT from MCS: ref #267673
2018-10-25 13:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267673  84 58416 47437050 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:10:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:10:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:10:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:10:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:10:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:10:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:10:41 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-10-25 13:10:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:11:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:11:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:11:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 13:11:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:11:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:11:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:11:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:11:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:11:41 [DEBUG   ] Finished updating board flags in 2.098 seconds
2018-10-25 13:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:12:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:12:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 13:12:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:12:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:12:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:12:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:12:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:12:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:12:41 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-10-25 13:12:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 13:13:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 13:13:10 [DEBUG   ] Got command RPT from MCS: ref #267691
2018-10-25 13:13:10 [DEBUG   ] summary = ERROR
2018-10-25 13:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267691  13 58416 47590225 A  ERRORERROR'
2018-10-25 13:13:10 [DEBUG   ] Got command RPT from MCS: ref #267692
2018-10-25 13:13:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267692  84 58416 47590429 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:13:10 [DEBUG   ] Got command RPT from MCS: ref #267693
2018-10-25 13:13:10 [DEBUG   ] summary = ERROR
2018-10-25 13:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267693  13 58416 47590633 A  ERRORERROR'
2018-10-25 13:13:10 [DEBUG   ] Got command RPT from MCS: ref #267694
2018-10-25 13:13:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267694  84 58416 47590837 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:13:11 [DEBUG   ] Got command RPT from MCS: ref #267696
2018-10-25 13:13:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267696  12 58416 47591029 A  ERRORB–™š'
2018-10-25 13:13:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 13:13:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:13:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:13:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:13:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:13:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:13:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:13:41 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-25 13:13:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 13:14:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:14:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:14:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:14:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:14:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:14:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:14:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:14:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:14:41 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-25 13:14:49 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-25 13:15:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:15:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:15:37 [DEBUG   ] Got command RPT from MCS: ref #267705
2018-10-25 13:15:37 [DEBUG   ] summary = ERROR
2018-10-25 13:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267705  13 58416 47737049 A  ERRORERROR'
2018-10-25 13:15:37 [DEBUG   ] Got command RPT from MCS: ref #267706
2018-10-25 13:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267706  84 58416 47737050 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:15:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:15:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:15:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:15:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:15:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:15:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:15:41 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-25 13:15:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:16:09 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-25 13:16:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:16:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:16:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:16:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:16:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:16:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:16:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:16:41 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-25 13:16:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 13:17:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:17:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:17:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:17:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:17:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:17:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:17:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:17:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:17:41 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-25 13:17:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:18:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:18:10 [DEBUG   ] Got command RPT from MCS: ref #267726
2018-10-25 13:18:10 [DEBUG   ] summary = ERROR
2018-10-25 13:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267726  13 58416 47890321 A  ERRORERROR'
2018-10-25 13:18:10 [DEBUG   ] Got command RPT from MCS: ref #267727
2018-10-25 13:18:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267727  84 58416 47890513 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:18:10 [DEBUG   ] Got command RPT from MCS: ref #267728
2018-10-25 13:18:10 [DEBUG   ] summary = ERROR
2018-10-25 13:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267728  13 58416 47890717 A  ERRORERROR'
2018-10-25 13:18:10 [DEBUG   ] Got command RPT from MCS: ref #267729
2018-10-25 13:18:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267729  84 58416 47890921 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:18:11 [DEBUG   ] Got command RPT from MCS: ref #267730
2018-10-25 13:18:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267730  12 58416 47891113 A  ERRORB•™š'
2018-10-25 13:18:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:18:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:18:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:18:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:18:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:18:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:18:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:18:41 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-25 13:18:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 13:19:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:19:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:19:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:19:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 13:19:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:19:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:19:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:19:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:19:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:19:41 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-25 13:19:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 13:20:10 [DEBUG   ] Finished updating ant stats in 1.384 seconds
2018-10-25 13:20:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 13:20:37 [DEBUG   ] Got command RPT from MCS: ref #267735
2018-10-25 13:20:37 [DEBUG   ] summary = ERROR
2018-10-25 13:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267735  13 58416 48037057 A  ERRORERROR'
2018-10-25 13:20:37 [DEBUG   ] Got command RPT from MCS: ref #267736
2018-10-25 13:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267736  84 58416 48037058 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:20:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:20:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:20:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:20:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:20:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:20:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:20:41 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-10-25 13:20:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 13:21:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 13:21:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 13:21:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:21:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:21:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:21:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:21:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:21:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:21:41 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-10-25 13:21:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 13:22:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:22:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 13:22:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:22:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:22:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-25 13:22:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:22:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:22:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:22:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:22:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:22:41 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-25 13:22:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:23:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 13:23:10 [DEBUG   ] Got command RPT from MCS: ref #267758
2018-10-25 13:23:10 [DEBUG   ] summary = ERROR
2018-10-25 13:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267758  13 58416 48190405 A  ERRORERROR'
2018-10-25 13:23:10 [DEBUG   ] Got command RPT from MCS: ref #267759
2018-10-25 13:23:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267759  84 58416 48190597 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:23:10 [DEBUG   ] Got command RPT from MCS: ref #267760
2018-10-25 13:23:10 [DEBUG   ] summary = ERROR
2018-10-25 13:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267760  13 58416 48190801 A  ERRORERROR'
2018-10-25 13:23:11 [DEBUG   ] Got command RPT from MCS: ref #267762
2018-10-25 13:23:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267762  84 58416 48191005 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:23:11 [DEBUG   ] Got command RPT from MCS: ref #267764
2018-10-25 13:23:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267764  12 58416 48191209 A  ERRORB—™š'
2018-10-25 13:23:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:23:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:23:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:23:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:23:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:23:41 [WARNING ] (13, 1, 'bot')
2018-10-25 13:23:41 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:23:41 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-25 13:23:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 13:24:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:24:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 13:24:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:24:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 13:24:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:24:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:24:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:24:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:24:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:24:42 [DEBUG   ] Finished updating board flags in 2.225 seconds
2018-10-25 13:24:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 13:25:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 13:25:31 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2018-10-25 13:25:37 [DEBUG   ] Got command RPT from MCS: ref #267772
2018-10-25 13:25:37 [DEBUG   ] summary = ERROR
2018-10-25 13:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267772  13 58416 48337057 A  ERRORERROR'
2018-10-25 13:25:37 [DEBUG   ] Got command RPT from MCS: ref #267773
2018-10-25 13:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267773  84 58416 48337058 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:25:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:25:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:25:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:25:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:25:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:25:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:25:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:25:42 [DEBUG   ] Finished updating board flags in 2.114 seconds
2018-10-25 13:25:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:26:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 13:26:30 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-25 13:26:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:26:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:26:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:26:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:26:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:26:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:26:42 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-10-25 13:26:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:27:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:27:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 13:27:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:27:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 13:27:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:27:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:27:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:27:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:27:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:27:42 [DEBUG   ] Finished updating board flags in 1.940 seconds
2018-10-25 13:27:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 13:28:10 [DEBUG   ] Got command RPT from MCS: ref #267789
2018-10-25 13:28:10 [DEBUG   ] summary = ERROR
2018-10-25 13:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267789  13 58416 48490493 A  ERRORERROR'
2018-10-25 13:28:10 [DEBUG   ] Got command RPT from MCS: ref #267790
2018-10-25 13:28:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267790  84 58416 48490685 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:28:10 [DEBUG   ] Got command RPT from MCS: ref #267791
2018-10-25 13:28:10 [DEBUG   ] summary = ERROR
2018-10-25 13:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267791  13 58416 48490889 A  ERRORERROR'
2018-10-25 13:28:11 [DEBUG   ] Got command RPT from MCS: ref #267792
2018-10-25 13:28:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267792  84 58416 48491093 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:28:11 [DEBUG   ] Got command RPT from MCS: ref #267793
2018-10-25 13:28:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267793  12 58416 48491297 A  ERRORB—™š'
2018-10-25 13:28:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 13:28:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 13:28:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:28:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:28:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:28:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:28:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:28:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:28:42 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-25 13:28:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:29:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 13:29:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 13:29:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:29:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:29:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:29:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:29:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:29:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:29:42 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-10-25 13:29:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:30:00 [DEBUG   ] Got command TBN from MCS: ref #267798
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-25 13:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   267798   8 58416 48600398 A  ERROR'
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540474201']
2018-10-25 13:30:00 [DEBUG   ] spawn_process: at 2018-10-25 13:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540474201']
2018-10-25 13:30:00 [INFO    ] Finished spawning TBN in 0.052 s
2018-10-25 13:30:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:30:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:30:37 [DEBUG   ] Got command RPT from MCS: ref #267799
2018-10-25 13:30:37 [DEBUG   ] summary = ERROR
2018-10-25 13:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267799  13 58416 48637061 A  ERRORERROR'
2018-10-25 13:30:37 [DEBUG   ] Got command RPT from MCS: ref #267800
2018-10-25 13:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267800  84 58416 48637062 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:30:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:30:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:30:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:30:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:30:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:30:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:30:42 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-25 13:30:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:31:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:31:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:31:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:31:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:31:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:31:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:31:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:31:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:31:42 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-10-25 13:31:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:32:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 13:32:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:32:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:32:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:32:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:32:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:32:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:32:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:32:42 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-25 13:32:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:33:10 [DEBUG   ] Got command RPT from MCS: ref #267822
2018-10-25 13:33:10 [DEBUG   ] summary = ERROR
2018-10-25 13:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267822  13 58416 48790573 A  ERRORERROR'
2018-10-25 13:33:10 [DEBUG   ] Got command RPT from MCS: ref #267823
2018-10-25 13:33:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267823  84 58416 48790777 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:33:10 [DEBUG   ] Got command RPT from MCS: ref #267824
2018-10-25 13:33:10 [DEBUG   ] summary = ERROR
2018-10-25 13:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267824  13 58416 48790969 A  ERRORERROR'
2018-10-25 13:33:11 [DEBUG   ] Got command RPT from MCS: ref #267826
2018-10-25 13:33:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267826  84 58416 48791173 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:33:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:33:11 [DEBUG   ] Got command RPT from MCS: ref #267828
2018-10-25 13:33:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267828  12 58416 48791377 A  ERRORB–™š'
2018-10-25 13:33:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:33:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:33:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:33:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:33:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:33:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:33:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:33:42 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-25 13:33:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:34:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:34:11 [DEBUG   ] Got command TBW from MCS: ref #267833
2018-10-25 13:34:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-25 13:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   267833   8 58416 48851474 A  ERROR'
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-25 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-25 13:34:14 [DEBUG   ] spawn_process: at 2018-10-25 13:34:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-25 13:34:15 [DEBUG   ] spawn_process: at 2018-10-25 13:34:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-25 13:34:15 [DEBUG   ] spawn_process: at 2018-10-25 13:34:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-25 13:34:15 [DEBUG   ] spawn_process: at 2018-10-25 13:34:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-25 13:34:15 [INFO    ] Finished spawning TBW
2018-10-25 13:34:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:34:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 13:34:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:34:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:34:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:34:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:34:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:34:42 [DEBUG   ] Finished updating board flags in 1.304 seconds
2018-10-25 13:35:37 [DEBUG   ] Got command RPT from MCS: ref #267841
2018-10-25 13:35:37 [DEBUG   ] summary = ERROR
2018-10-25 13:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267841  13 58416 48937053 A  ERRORERROR'
2018-10-25 13:35:37 [DEBUG   ] Got command RPT from MCS: ref #267842
2018-10-25 13:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267842  84 58416 48937054 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:35:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:35:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:35:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:35:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:35:42 [WARNING ] (13, 1, 'bot')
2018-10-25 13:35:42 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:35:42 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-10-25 13:36:03 [INFO    ] __waitForTBW - TBW finished in 108.827 s
2018-10-25 13:36:04 [DEBUG   ] Finished updating ant stats in 0.473 seconds
2018-10-25 13:36:04 [INFO    ] Started antennas statistics background thread
2018-10-25 13:36:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540474566']
2018-10-25 13:36:04 [DEBUG   ] spawn_process: at 2018-10-25 13:36:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540474566']
2018-10-25 13:36:04 [INFO    ] Finished spawning TBN in 0.049 s
2018-10-25 13:36:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-10-25 13:36:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:36:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:36:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:36:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:36:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:36:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:36:43 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-10-25 13:36:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:37:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 13:37:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:37:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:37:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:37:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:37:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:37:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:37:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:37:43 [DEBUG   ] Finished updating board flags in 2.338 seconds
2018-10-25 13:37:44 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-25 13:38:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:38:10 [DEBUG   ] Got command RPT from MCS: ref #267866
2018-10-25 13:38:10 [DEBUG   ] summary = ERROR
2018-10-25 13:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267866  13 58416 49090661 A  ERRORERROR'
2018-10-25 13:38:10 [DEBUG   ] Got command RPT from MCS: ref #267867
2018-10-25 13:38:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267867  84 58416 49090865 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:38:11 [DEBUG   ] Got command RPT from MCS: ref #267868
2018-10-25 13:38:11 [DEBUG   ] summary = ERROR
2018-10-25 13:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267868  13 58416 49091057 A  ERRORERROR'
2018-10-25 13:38:11 [DEBUG   ] Got command RPT from MCS: ref #267869
2018-10-25 13:38:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267869  84 58416 49091261 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:38:11 [DEBUG   ] Got command RPT from MCS: ref #267870
2018-10-25 13:38:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267870  12 58416 49091465 A  ERRORB—™š'
2018-10-25 13:38:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:38:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:38:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:38:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:38:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:38:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:38:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:38:43 [DEBUG   ] Finished updating board flags in 2.146 seconds
2018-10-25 13:38:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 13:39:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 13:39:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:39:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:39:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:39:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:39:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:39:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:39:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:39:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:39:43 [DEBUG   ] Finished updating board flags in 1.910 seconds
2018-10-25 13:39:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 13:40:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:40:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:40:37 [DEBUG   ] Got command RPT from MCS: ref #267875
2018-10-25 13:40:37 [DEBUG   ] summary = ERROR
2018-10-25 13:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267875  13 58416 49237065 A  ERRORERROR'
2018-10-25 13:40:37 [DEBUG   ] Got command RPT from MCS: ref #267876
2018-10-25 13:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267876  84 58416 49237066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:40:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:40:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:40:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:40:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:40:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:40:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:40:43 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-25 13:40:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:41:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:41:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 13:41:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:41:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:41:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:41:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:41:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:41:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:41:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:41:43 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-25 13:41:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:42:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 13:42:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:42:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:42:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:42:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:42:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:42:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:42:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:42:43 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-25 13:42:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:43:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:43:10 [DEBUG   ] Got command RPT from MCS: ref #267894
2018-10-25 13:43:10 [DEBUG   ] summary = ERROR
2018-10-25 13:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267894  13 58416 49390741 A  ERRORERROR'
2018-10-25 13:43:10 [DEBUG   ] Got command RPT from MCS: ref #267895
2018-10-25 13:43:10 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267895  84 58416 49390945 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:43:11 [DEBUG   ] Got command RPT from MCS: ref #267896
2018-10-25 13:43:11 [DEBUG   ] summary = ERROR
2018-10-25 13:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267896  13 58416 49391149 A  ERRORERROR'
2018-10-25 13:43:11 [DEBUG   ] Got command RPT from MCS: ref #267898
2018-10-25 13:43:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267898  84 58416 49391353 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:43:11 [DEBUG   ] Got command RPT from MCS: ref #267900
2018-10-25 13:43:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267900  12 58416 49391545 A  ERRORB—™š'
2018-10-25 13:43:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:43:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:43:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:43:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:43:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:43:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:43:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:43:43 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-25 13:43:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:44:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:44:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:44:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:44:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 13:44:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:44:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:44:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:44:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:44:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:44:43 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-25 13:44:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 13:45:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 13:45:26 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-25 13:45:37 [DEBUG   ] Got command RPT from MCS: ref #267908
2018-10-25 13:45:37 [DEBUG   ] summary = ERROR
2018-10-25 13:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267908  13 58416 49537057 A  ERRORERROR'
2018-10-25 13:45:37 [DEBUG   ] Got command RPT from MCS: ref #267909
2018-10-25 13:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267909  84 58416 49537058 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:45:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:45:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:45:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:45:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:45:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:45:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:45:43 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-25 13:45:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:46:06 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-25 13:46:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:46:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:46:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:46:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:46:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:46:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:46:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:46:43 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-10-25 13:46:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 13:47:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:47:26 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2018-10-25 13:47:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:47:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:47:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:47:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:47:43 [WARNING ] (13, 1, 'bot')
2018-10-25 13:47:43 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:47:43 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-10-25 13:47:45 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-25 13:48:06 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-25 13:48:10 [DEBUG   ] Got command RPT from MCS: ref #267929
2018-10-25 13:48:10 [DEBUG   ] summary = ERROR
2018-10-25 13:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267929  13 58416 49690829 A  ERRORERROR'
2018-10-25 13:48:11 [DEBUG   ] Got command RPT from MCS: ref #267930
2018-10-25 13:48:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267930  84 58416 49691033 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:48:11 [DEBUG   ] Got command RPT from MCS: ref #267931
2018-10-25 13:48:11 [DEBUG   ] summary = ERROR
2018-10-25 13:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267931  13 58416 49691237 A  ERRORERROR'
2018-10-25 13:48:11 [DEBUG   ] Got command RPT from MCS: ref #267932
2018-10-25 13:48:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267932  84 58416 49691429 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:48:11 [DEBUG   ] Got command RPT from MCS: ref #267933
2018-10-25 13:48:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267933  12 58416 49691633 A  ERRORB–™š'
2018-10-25 13:48:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:48:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:48:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:48:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:48:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:48:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:48:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:48:44 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-10-25 13:48:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:49:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 13:49:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 13:49:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:49:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:49:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:49:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:49:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:49:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:49:44 [DEBUG   ] Finished updating board flags in 1.870 seconds
2018-10-25 13:49:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 13:50:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 13:50:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:50:37 [DEBUG   ] Got command RPT from MCS: ref #267944
2018-10-25 13:50:37 [DEBUG   ] summary = ERROR
2018-10-25 13:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267944  13 58416 49837065 A  ERRORERROR'
2018-10-25 13:50:37 [DEBUG   ] Got command RPT from MCS: ref #267945
2018-10-25 13:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267945  84 58416 49837066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:50:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:50:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:50:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:50:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:50:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:50:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:50:44 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-25 13:50:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:51:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 13:51:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-25 13:51:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:51:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:51:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:51:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:51:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:51:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:51:44 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-25 13:51:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:52:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:52:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:52:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:52:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 13:52:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:52:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:52:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:52:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:52:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:52:44 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-25 13:52:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 13:53:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 13:53:10 [DEBUG   ] Got command RPT from MCS: ref #267972
2018-10-25 13:53:10 [DEBUG   ] summary = ERROR
2018-10-25 13:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267972  13 58416 49990917 A  ERRORERROR'
2018-10-25 13:53:11 [DEBUG   ] Got command RPT from MCS: ref #267973
2018-10-25 13:53:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267973  84 58416 49991121 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:53:11 [DEBUG   ] Got command RPT from MCS: ref #267974
2018-10-25 13:53:11 [DEBUG   ] summary = ERROR
2018-10-25 13:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267974  13 58416 49991313 A  ERRORERROR'
2018-10-25 13:53:11 [DEBUG   ] Got command RPT from MCS: ref #267976
2018-10-25 13:53:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267976  84 58416 49991517 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:53:11 [DEBUG   ] Got command RPT from MCS: ref #267977
2018-10-25 13:53:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267977  12 58416 49991721 A  ERRORB–™š'
2018-10-25 13:53:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 13:53:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:53:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:53:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:53:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:53:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:53:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:53:44 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-25 13:53:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 13:54:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-25 13:54:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 13:54:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:54:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:54:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:54:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:54:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:54:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:54:44 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-25 13:54:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 13:55:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 13:55:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 13:55:37 [DEBUG   ] Got command RPT from MCS: ref #267986
2018-10-25 13:55:37 [DEBUG   ] summary = ERROR
2018-10-25 13:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267986  13 58416 50137069 A  ERRORERROR'
2018-10-25 13:55:37 [DEBUG   ] Got command RPT from MCS: ref #267987
2018-10-25 13:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   267987  84 58416 50137070 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:55:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:55:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:55:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:55:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:55:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:55:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:55:44 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-25 13:55:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:56:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:56:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:56:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:56:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:56:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:56:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:56:44 [WARNING ] (13, 1, 'bot')
2018-10-25 13:56:44 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:56:44 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-25 13:56:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 13:57:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 13:57:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 13:57:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:57:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 13:57:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:57:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:57:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:57:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:57:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:57:45 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-25 13:57:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 13:58:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 13:58:11 [DEBUG   ] Got command RPT from MCS: ref #268003
2018-10-25 13:58:11 [DEBUG   ] summary = ERROR
2018-10-25 13:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268003  13 58416 50291005 A  ERRORERROR'
2018-10-25 13:58:11 [DEBUG   ] Got command RPT from MCS: ref #268004
2018-10-25 13:58:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268004  84 58416 50291209 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:58:11 [DEBUG   ] Got command RPT from MCS: ref #268005
2018-10-25 13:58:11 [DEBUG   ] summary = ERROR
2018-10-25 13:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268005  13 58416 50291401 A  ERRORERROR'
2018-10-25 13:58:11 [DEBUG   ] Got command RPT from MCS: ref #268006
2018-10-25 13:58:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 13:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268006  84 58416 50291605 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 13:58:11 [DEBUG   ] Got command RPT from MCS: ref #268007
2018-10-25 13:58:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 13:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268007  12 58416 50291809 A  ERRORB—™š'
2018-10-25 13:58:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 13:58:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:58:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:58:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:58:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:58:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:58:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:58:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:58:45 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-10-25 13:58:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 13:59:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:59:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 13:59:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 13:59:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 13:59:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:59:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:59:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:59:45 [WARNING ] (13, 1, 'bot')
2018-10-25 13:59:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 13:59:45 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-25 13:59:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:00:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:00:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 14:00:37 [DEBUG   ] Got command RPT from MCS: ref #268012
2018-10-25 14:00:37 [DEBUG   ] summary = ERROR
2018-10-25 14:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268012  13 58416 50437065 A  ERRORERROR'
2018-10-25 14:00:37 [DEBUG   ] Got command RPT from MCS: ref #268013
2018-10-25 14:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268013  84 58416 50437066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:00:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 14:00:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:00:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:00:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:00:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:00:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:00:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:00:45 [DEBUG   ] Finished updating board flags in 1.696 seconds
2018-10-25 14:00:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:01:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:01:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:01:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:01:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:01:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:01:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:01:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:01:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:01:45 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-10-25 14:01:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 14:02:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:02:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:02:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:02:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:02:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:02:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:02:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:02:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:02:45 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-10-25 14:02:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 14:03:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 14:03:11 [DEBUG   ] Got command RPT from MCS: ref #268035
2018-10-25 14:03:11 [DEBUG   ] summary = ERROR
2018-10-25 14:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268035  13 58416 50591081 A  ERRORERROR'
2018-10-25 14:03:11 [DEBUG   ] Got command RPT from MCS: ref #268036
2018-10-25 14:03:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268036  84 58416 50591285 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:03:11 [DEBUG   ] Got command RPT from MCS: ref #268037
2018-10-25 14:03:11 [DEBUG   ] summary = ERROR
2018-10-25 14:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268037  13 58416 50591489 A  ERRORERROR'
2018-10-25 14:03:11 [DEBUG   ] Got command RPT from MCS: ref #268039
2018-10-25 14:03:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268039  84 58416 50591693 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:03:11 [DEBUG   ] Got command RPT from MCS: ref #268041
2018-10-25 14:03:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268041  12 58416 50591885 A  ERRORB–™š'
2018-10-25 14:03:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:03:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:03:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:03:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:03:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:03:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:03:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:03:45 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-25 14:03:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 14:04:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 14:04:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:04:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:04:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:04:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:04:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:04:45 [WARNING ] (13, 1, 'bot')
2018-10-25 14:04:45 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:04:45 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-10-25 14:04:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 14:05:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 14:05:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:05:37 [DEBUG   ] Got command RPT from MCS: ref #268049
2018-10-25 14:05:37 [DEBUG   ] summary = ERROR
2018-10-25 14:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268049  13 58416 50737061 A  ERRORERROR'
2018-10-25 14:05:37 [DEBUG   ] Got command RPT from MCS: ref #268050
2018-10-25 14:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268050  84 58416 50737062 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:05:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:05:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 14:05:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:05:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:05:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:05:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:05:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:05:46 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-25 14:05:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 14:06:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:06:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 14:06:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:06:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:06:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:06:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:06:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:06:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:06:46 [DEBUG   ] Finished updating board flags in 2.255 seconds
2018-10-25 14:06:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:07:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:07:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:07:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:07:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 14:07:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:07:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:07:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:07:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:07:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:07:46 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-10-25 14:07:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 14:08:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 14:08:11 [DEBUG   ] Got command RPT from MCS: ref #268070
2018-10-25 14:08:11 [DEBUG   ] summary = ERROR
2018-10-25 14:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268070  13 58416 50891177 A  ERRORERROR'
2018-10-25 14:08:11 [DEBUG   ] Got command RPT from MCS: ref #268071
2018-10-25 14:08:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268071  84 58416 50891369 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:08:11 [DEBUG   ] Got command RPT from MCS: ref #268072
2018-10-25 14:08:11 [DEBUG   ] summary = ERROR
2018-10-25 14:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268072  13 58416 50891573 A  ERRORERROR'
2018-10-25 14:08:11 [DEBUG   ] Got command RPT from MCS: ref #268073
2018-10-25 14:08:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268073  84 58416 50891777 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:08:11 [DEBUG   ] Got command RPT from MCS: ref #268074
2018-10-25 14:08:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268074  12 58416 50891981 A  ERRORB•™š'
2018-10-25 14:08:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:08:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:08:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:08:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:08:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:08:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:08:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:08:46 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-25 14:08:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:09:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 14:09:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:09:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:09:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:09:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:09:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:09:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:09:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:09:46 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-25 14:09:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 14:10:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:10:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 14:10:37 [DEBUG   ] Got command RPT from MCS: ref #268079
2018-10-25 14:10:37 [DEBUG   ] summary = ERROR
2018-10-25 14:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268079  13 58416 51037069 A  ERRORERROR'
2018-10-25 14:10:37 [DEBUG   ] Got command RPT from MCS: ref #268080
2018-10-25 14:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268080  84 58416 51037070 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:10:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:10:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:10:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:10:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:10:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:10:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:10:46 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-25 14:10:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 14:11:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 14:11:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 14:11:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:11:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 14:11:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:11:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:11:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:11:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:11:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:11:46 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-10-25 14:11:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:12:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 14:12:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 14:12:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:12:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:12:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:12:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:12:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:12:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:12:46 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 14:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:13:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:13:11 [DEBUG   ] Got command RPT from MCS: ref #268098
2018-10-25 14:13:11 [DEBUG   ] summary = ERROR
2018-10-25 14:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268098  13 58416 51191257 A  ERRORERROR'
2018-10-25 14:13:11 [DEBUG   ] Got command RPT from MCS: ref #268099
2018-10-25 14:13:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268099  84 58416 51191461 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:13:11 [DEBUG   ] Got command RPT from MCS: ref #268100
2018-10-25 14:13:11 [DEBUG   ] summary = ERROR
2018-10-25 14:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268100  13 58416 51191654 A  ERRORERROR'
2018-10-25 14:13:11 [DEBUG   ] Got command RPT from MCS: ref #268102
2018-10-25 14:13:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268102  84 58416 51191857 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:13:12 [DEBUG   ] Got command RPT from MCS: ref #268103
2018-10-25 14:13:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268103  12 58416 51192061 A  ERRORB•™š'
2018-10-25 14:13:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:13:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:13:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 14:13:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:13:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:13:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:13:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:13:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:13:46 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-25 14:13:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:14:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:14:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:14:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:14:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:14:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:14:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:14:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:14:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:14:46 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-10-25 14:14:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:15:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:15:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:15:37 [DEBUG   ] Got command RPT from MCS: ref #268112
2018-10-25 14:15:37 [DEBUG   ] summary = ERROR
2018-10-25 14:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268112  13 58416 51337065 A  ERRORERROR'
2018-10-25 14:15:37 [DEBUG   ] Got command RPT from MCS: ref #268113
2018-10-25 14:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268113  84 58416 51337066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:15:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:15:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:15:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:15:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:15:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:15:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:15:46 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-25 14:15:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:16:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:16:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:16:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:16:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:16:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:16:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:16:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:16:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:16:46 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-10-25 14:16:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 14:17:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:17:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:17:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 14:17:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:17:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:17:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:17:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:17:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:17:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:17:46 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-10-25 14:17:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:18:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:18:11 [DEBUG   ] Got command RPT from MCS: ref #268133
2018-10-25 14:18:11 [DEBUG   ] summary = ERROR
2018-10-25 14:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268133  13 58416 51491349 A  ERRORERROR'
2018-10-25 14:18:11 [DEBUG   ] Got command RPT from MCS: ref #268134
2018-10-25 14:18:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268134  84 58416 51491541 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:18:11 [DEBUG   ] Got command RPT from MCS: ref #268135
2018-10-25 14:18:11 [DEBUG   ] summary = ERROR
2018-10-25 14:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268135  13 58416 51491745 A  ERRORERROR'
2018-10-25 14:18:11 [DEBUG   ] Got command RPT from MCS: ref #268136
2018-10-25 14:18:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268136  84 58416 51491949 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:18:12 [DEBUG   ] Got command RPT from MCS: ref #268137
2018-10-25 14:18:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268137  12 58416 51492141 A  ERRORB—™š'
2018-10-25 14:18:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:18:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:18:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 14:18:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:18:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:18:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:18:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:18:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:18:46 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-25 14:18:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:19:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:19:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:19:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:19:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 14:19:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:19:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:19:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:19:46 [WARNING ] (13, 1, 'bot')
2018-10-25 14:19:46 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:19:46 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-10-25 14:19:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 14:20:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:20:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:20:37 [DEBUG   ] Got command RPT from MCS: ref #268142
2018-10-25 14:20:37 [DEBUG   ] summary = ERROR
2018-10-25 14:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268142  13 58416 51637065 A  ERRORERROR'
2018-10-25 14:20:37 [DEBUG   ] Got command RPT from MCS: ref #268143
2018-10-25 14:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268143  84 58416 51637066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:20:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 14:20:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:20:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:20:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:20:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:20:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:20:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:20:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:20:48 [DEBUG   ] Finished updating board flags in 3.105 seconds
2018-10-25 14:21:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:21:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:21:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:21:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:21:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:21:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:21:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:21:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:21:47 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-10-25 14:21:48 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-25 14:22:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 14:22:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:22:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:22:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:22:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:22:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:22:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:22:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:22:47 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-25 14:22:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:23:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:23:11 [DEBUG   ] Got command RPT from MCS: ref #268165
2018-10-25 14:23:11 [DEBUG   ] summary = ERROR
2018-10-25 14:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268165  13 58416 51791425 A  ERRORERROR'
2018-10-25 14:23:11 [DEBUG   ] Got command RPT from MCS: ref #268166
2018-10-25 14:23:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268166  84 58416 51791629 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:23:11 [DEBUG   ] Got command RPT from MCS: ref #268167
2018-10-25 14:23:11 [DEBUG   ] summary = ERROR
2018-10-25 14:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268167  13 58416 51791833 A  ERRORERROR'
2018-10-25 14:23:12 [DEBUG   ] Got command RPT from MCS: ref #268169
2018-10-25 14:23:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268169  84 58416 51792037 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:23:12 [DEBUG   ] Got command RPT from MCS: ref #268170
2018-10-25 14:23:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268170  12 58416 51792229 A  ERRORB–™š'
2018-10-25 14:23:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 14:23:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:23:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:23:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:23:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:23:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:23:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:23:47 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-10-25 14:23:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:24:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:24:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:24:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:24:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:24:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:24:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:24:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:24:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:24:47 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-25 14:24:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 14:25:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:25:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:25:37 [DEBUG   ] Got command RPT from MCS: ref #268179
2018-10-25 14:25:37 [DEBUG   ] summary = ERROR
2018-10-25 14:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268179  13 58416 51937065 A  ERRORERROR'
2018-10-25 14:25:37 [DEBUG   ] Got command RPT from MCS: ref #268180
2018-10-25 14:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268180  84 58416 51937066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:25:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:25:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:25:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:25:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:25:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:25:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:25:47 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-10-25 14:25:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:26:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:26:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:26:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:26:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:26:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:26:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:26:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:26:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:26:47 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-25 14:26:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:27:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:27:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 14:27:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:27:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:27:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:27:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:27:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:27:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:27:47 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-25 14:27:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:28:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:28:11 [DEBUG   ] Got command RPT from MCS: ref #268196
2018-10-25 14:28:11 [DEBUG   ] summary = ERROR
2018-10-25 14:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268196  13 58416 52091517 A  ERRORERROR'
2018-10-25 14:28:11 [DEBUG   ] Got command RPT from MCS: ref #268197
2018-10-25 14:28:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268197  84 58416 52091721 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:28:11 [DEBUG   ] Got command RPT from MCS: ref #268198
2018-10-25 14:28:11 [DEBUG   ] summary = ERROR
2018-10-25 14:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268198  13 58416 52091913 A  ERRORERROR'
2018-10-25 14:28:12 [DEBUG   ] Got command RPT from MCS: ref #268199
2018-10-25 14:28:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268199  84 58416 52092117 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:28:12 [DEBUG   ] Got command RPT from MCS: ref #268200
2018-10-25 14:28:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268200  12 58416 52092321 A  ERRORB•™š'
2018-10-25 14:28:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:28:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:28:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:28:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:28:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:28:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:28:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:28:47 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-25 14:28:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 14:29:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:29:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:29:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:29:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:29:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:29:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:29:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:29:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:29:47 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-10-25 14:29:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 14:30:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 14:30:29 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-25 14:30:37 [DEBUG   ] Got command RPT from MCS: ref #268205
2018-10-25 14:30:37 [DEBUG   ] summary = ERROR
2018-10-25 14:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268205  13 58416 52237065 A  ERRORERROR'
2018-10-25 14:30:37 [DEBUG   ] Got command RPT from MCS: ref #268206
2018-10-25 14:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268206  84 58416 52237066 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:30:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:30:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:30:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:30:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:30:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:30:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:30:47 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-25 14:30:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 14:31:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:31:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:31:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:31:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:31:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:31:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:31:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:31:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:31:47 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-25 14:31:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 14:32:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:32:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:32:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:32:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:32:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:32:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:32:47 [WARNING ] (13, 1, 'bot')
2018-10-25 14:32:47 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:32:47 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-25 14:32:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:33:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 14:33:11 [DEBUG   ] Got command RPT from MCS: ref #268228
2018-10-25 14:33:11 [DEBUG   ] summary = ERROR
2018-10-25 14:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268228  13 58416 52391601 A  ERRORERROR'
2018-10-25 14:33:11 [DEBUG   ] Got command RPT from MCS: ref #268229
2018-10-25 14:33:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268229  84 58416 52391805 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:33:11 [DEBUG   ] Got command RPT from MCS: ref #268230
2018-10-25 14:33:11 [DEBUG   ] summary = ERROR
2018-10-25 14:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268230  13 58416 52391997 A  ERRORERROR'
2018-10-25 14:33:12 [DEBUG   ] Got command RPT from MCS: ref #268232
2018-10-25 14:33:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268232  84 58416 52392201 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:33:12 [DEBUG   ] Got command RPT from MCS: ref #268233
2018-10-25 14:33:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268233  12 58416 52392405 A  ERRORB–™š'
2018-10-25 14:33:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:33:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 14:33:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:33:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 14:33:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:33:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:33:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:33:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:33:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:33:48 [DEBUG   ] Finished updating board flags in 2.149 seconds
2018-10-25 14:33:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:34:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:34:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:34:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:34:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:34:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:34:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:34:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:34:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:34:48 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-10-25 14:34:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 14:35:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:35:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:35:37 [DEBUG   ] Got command RPT from MCS: ref #268242
2018-10-25 14:35:37 [DEBUG   ] summary = ERROR
2018-10-25 14:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268242  13 58416 52537069 A  ERRORERROR'
2018-10-25 14:35:37 [DEBUG   ] Got command RPT from MCS: ref #268243
2018-10-25 14:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268243  84 58416 52537070 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:35:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:35:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:35:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:35:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:35:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:35:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:35:48 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-10-25 14:35:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:36:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:36:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:36:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:36:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:36:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:36:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:36:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:36:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:36:48 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-10-25 14:36:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 14:37:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 14:37:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:37:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:37:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:37:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:37:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:37:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:37:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:37:48 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-25 14:37:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 14:38:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:38:11 [DEBUG   ] Got command RPT from MCS: ref #268263
2018-10-25 14:38:11 [DEBUG   ] summary = ERROR
2018-10-25 14:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268263  13 58416 52691689 A  ERRORERROR'
2018-10-25 14:38:11 [DEBUG   ] Got command RPT from MCS: ref #268264
2018-10-25 14:38:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268264  84 58416 52691881 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:38:12 [DEBUG   ] Got command RPT from MCS: ref #268265
2018-10-25 14:38:12 [DEBUG   ] summary = ERROR
2018-10-25 14:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268265  13 58416 52692085 A  ERRORERROR'
2018-10-25 14:38:12 [DEBUG   ] Got command RPT from MCS: ref #268266
2018-10-25 14:38:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268266  84 58416 52692289 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:38:12 [DEBUG   ] Got command RPT from MCS: ref #268267
2018-10-25 14:38:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268267  12 58416 52692493 A  ERRORB—™š'
2018-10-25 14:38:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:38:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:38:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:38:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:38:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:38:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:38:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:38:48 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-25 14:38:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 14:39:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 14:39:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 14:39:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:39:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:39:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:39:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:39:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:39:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:39:48 [DEBUG   ] Finished updating board flags in 1.554 seconds
2018-10-25 14:39:49 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 14:40:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 14:40:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 14:40:37 [DEBUG   ] Got command RPT from MCS: ref #268272
2018-10-25 14:40:37 [DEBUG   ] summary = ERROR
2018-10-25 14:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268272  13 58416 52837073 A  ERRORERROR'
2018-10-25 14:40:37 [DEBUG   ] Got command RPT from MCS: ref #268273
2018-10-25 14:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268273  84 58416 52837074 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:40:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:40:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:40:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:40:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:40:48 [WARNING ] (13, 1, 'bot')
2018-10-25 14:40:48 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:40:48 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-25 14:40:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:41:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:41:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:41:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:41:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:41:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:41:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:41:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:41:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:41:49 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-10-25 14:41:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-25 14:42:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:42:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:42:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:42:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:42:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:42:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:42:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:42:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:42:49 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-10-25 14:42:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 14:43:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 14:43:11 [DEBUG   ] Got command RPT from MCS: ref #268291
2018-10-25 14:43:11 [DEBUG   ] summary = ERROR
2018-10-25 14:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268291  13 58416 52991765 A  ERRORERROR'
2018-10-25 14:43:11 [DEBUG   ] Got command RPT from MCS: ref #268292
2018-10-25 14:43:11 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268292  84 58416 52991969 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:43:12 [DEBUG   ] Got command RPT from MCS: ref #268293
2018-10-25 14:43:12 [DEBUG   ] summary = ERROR
2018-10-25 14:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268293  13 58416 52992173 A  ERRORERROR'
2018-10-25 14:43:12 [DEBUG   ] Got command RPT from MCS: ref #268295
2018-10-25 14:43:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268295  84 58416 52992377 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:43:12 [DEBUG   ] Got command RPT from MCS: ref #268296
2018-10-25 14:43:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268296  12 58416 52992569 A  ERRORB–™š'
2018-10-25 14:43:30 [DEBUG   ] Finished updating ant stats in 0.962 seconds
2018-10-25 14:43:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:43:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:43:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:43:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:43:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:43:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:43:49 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-10-25 14:43:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:44:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:44:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:44:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:44:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:44:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:44:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:44:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:44:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:44:49 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-25 14:44:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:45:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:45:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 14:45:37 [DEBUG   ] Got command RPT from MCS: ref #268305
2018-10-25 14:45:37 [DEBUG   ] summary = ERROR
2018-10-25 14:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268305  13 58416 53137077 A  ERRORERROR'
2018-10-25 14:45:37 [DEBUG   ] Got command RPT from MCS: ref #268306
2018-10-25 14:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268306  84 58416 53137078 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:45:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:45:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:45:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:45:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:45:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:45:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:45:49 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-10-25 14:45:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:46:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:46:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:46:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:46:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:46:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:46:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:46:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:46:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:46:49 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-25 14:46:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:47:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:47:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:47:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:47:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:47:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:47:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:47:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:47:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:47:49 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-25 14:47:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 14:48:10 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-25 14:48:11 [DEBUG   ] Got command RPT from MCS: ref #268326
2018-10-25 14:48:11 [DEBUG   ] summary = ERROR
2018-10-25 14:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268326  13 58416 53291850 A  ERRORERROR'
2018-10-25 14:48:12 [DEBUG   ] Got command RPT from MCS: ref #268327
2018-10-25 14:48:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268327  84 58416 53292054 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:48:12 [DEBUG   ] Got command RPT from MCS: ref #268328
2018-10-25 14:48:12 [DEBUG   ] summary = ERROR
2018-10-25 14:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268328  13 58416 53292257 A  ERRORERROR'
2018-10-25 14:48:12 [DEBUG   ] Got command RPT from MCS: ref #268329
2018-10-25 14:48:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268329  84 58416 53292461 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:48:12 [DEBUG   ] Got command RPT from MCS: ref #268330
2018-10-25 14:48:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268330  12 58416 53292654 A  ERRORB•™š'
2018-10-25 14:48:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 14:48:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:48:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:48:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:48:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:48:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:48:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:48:49 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-10-25 14:48:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 14:49:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 14:49:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:49:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:49:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:49:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:49:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:49:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:49:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:49:49 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-25 14:49:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 14:50:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:50:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 14:50:37 [DEBUG   ] Got command RPT from MCS: ref #268335
2018-10-25 14:50:37 [DEBUG   ] summary = ERROR
2018-10-25 14:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268335  13 58416 53437073 A  ERRORERROR'
2018-10-25 14:50:37 [DEBUG   ] Got command RPT from MCS: ref #268336
2018-10-25 14:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268336  84 58416 53437074 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:50:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:50:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:50:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:50:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:50:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:50:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:50:49 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-25 14:50:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:51:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 14:51:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 14:51:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:51:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:51:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:51:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:51:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:51:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:51:49 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-25 14:51:51 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-25 14:52:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 14:52:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 14:52:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:52:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:52:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:52:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:52:49 [WARNING ] (13, 1, 'bot')
2018-10-25 14:52:49 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:52:49 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-25 14:52:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 14:53:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 14:53:11 [DEBUG   ] Got command RPT from MCS: ref #268358
2018-10-25 14:53:11 [DEBUG   ] summary = ERROR
2018-10-25 14:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268358  13 58416 53591941 A  ERRORERROR'
2018-10-25 14:53:12 [DEBUG   ] Got command RPT from MCS: ref #268359
2018-10-25 14:53:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268359  84 58416 53592145 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:53:12 [DEBUG   ] Got command RPT from MCS: ref #268360
2018-10-25 14:53:12 [DEBUG   ] summary = ERROR
2018-10-25 14:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268360  13 58416 53592337 A  ERRORERROR'
2018-10-25 14:53:12 [DEBUG   ] Got command RPT from MCS: ref #268362
2018-10-25 14:53:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268362  84 58416 53592541 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:53:12 [DEBUG   ] Got command RPT from MCS: ref #268363
2018-10-25 14:53:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268363  12 58416 53592745 A  ERRORB•™š'
2018-10-25 14:53:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 14:53:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:53:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:53:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:53:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:53:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:53:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:53:50 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-10-25 14:53:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 14:54:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 14:54:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 14:54:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:54:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:54:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:54:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:54:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:54:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:54:50 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-10-25 14:54:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 14:55:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 14:55:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:55:37 [DEBUG   ] Got command RPT from MCS: ref #268372
2018-10-25 14:55:37 [DEBUG   ] summary = ERROR
2018-10-25 14:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268372  13 58416 53737073 A  ERRORERROR'
2018-10-25 14:55:37 [DEBUG   ] Got command RPT from MCS: ref #268373
2018-10-25 14:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268373  84 58416 53737074 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:55:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:55:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:55:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:55:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:55:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:55:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:55:50 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-25 14:55:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:56:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:56:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:56:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:56:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:56:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:56:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:56:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:56:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:56:50 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-25 14:56:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:57:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:57:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:57:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:57:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:57:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:57:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:57:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:57:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:57:50 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-25 14:57:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 14:58:12 [DEBUG   ] Got command RPT from MCS: ref #268389
2018-10-25 14:58:12 [DEBUG   ] summary = ERROR
2018-10-25 14:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268389  13 58416 53892025 A  ERRORERROR'
2018-10-25 14:58:12 [DEBUG   ] Got command RPT from MCS: ref #268390
2018-10-25 14:58:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268390  84 58416 53892229 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:58:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:58:12 [DEBUG   ] Got command RPT from MCS: ref #268391
2018-10-25 14:58:12 [DEBUG   ] summary = ERROR
2018-10-25 14:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268391  13 58416 53892421 A  ERRORERROR'
2018-10-25 14:58:12 [DEBUG   ] Got command RPT from MCS: ref #268392
2018-10-25 14:58:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 14:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268392  84 58416 53892625 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 14:58:12 [DEBUG   ] Got command RPT from MCS: ref #268393
2018-10-25 14:58:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 14:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268393  12 58416 53892829 A  ERRORB—™š'
2018-10-25 14:58:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:58:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:58:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:58:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:58:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:58:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:58:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:58:50 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-25 14:58:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:59:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 14:59:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 14:59:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 14:59:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:59:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:59:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:59:50 [WARNING ] (13, 1, 'bot')
2018-10-25 14:59:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 14:59:50 [DEBUG   ] Finished updating board flags in 1.688 seconds
2018-10-25 14:59:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:00:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 15:00:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:00:37 [DEBUG   ] Got command RPT from MCS: ref #268398
2018-10-25 15:00:37 [DEBUG   ] summary = ERROR
2018-10-25 15:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268398  13 58416 54037085 A  ERRORERROR'
2018-10-25 15:00:37 [DEBUG   ] Got command RPT from MCS: ref #268399
2018-10-25 15:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268399  84 58416 54037086 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:00:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 15:00:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:00:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:00:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:00:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:00:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:00:50 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-10-25 15:00:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 15:01:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:01:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:01:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:01:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 15:01:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:01:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:01:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:01:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:01:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:01:50 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-25 15:01:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 15:02:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:02:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:02:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:02:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:02:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:02:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:02:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:02:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:02:50 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-10-25 15:02:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:03:12 [DEBUG   ] Got command RPT from MCS: ref #268421
2018-10-25 15:03:12 [DEBUG   ] summary = ERROR
2018-10-25 15:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268421  13 58416 54192105 A  ERRORERROR'
2018-10-25 15:03:12 [DEBUG   ] Got command RPT from MCS: ref #268422
2018-10-25 15:03:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268422  84 58416 54192310 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:03:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:03:12 [DEBUG   ] Got command RPT from MCS: ref #268423
2018-10-25 15:03:12 [DEBUG   ] summary = ERROR
2018-10-25 15:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268423  13 58416 54192513 A  ERRORERROR'
2018-10-25 15:03:12 [DEBUG   ] Got command RPT from MCS: ref #268425
2018-10-25 15:03:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268425  84 58416 54192717 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:03:12 [DEBUG   ] Got command RPT from MCS: ref #268426
2018-10-25 15:03:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268426  12 58416 54192909 A  ERRORB—™š'
2018-10-25 15:03:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:03:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:03:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:03:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:03:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:03:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:03:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:03:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:03:50 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-10-25 15:03:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:04:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:04:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 15:04:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:04:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:04:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:04:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:04:50 [WARNING ] (13, 1, 'bot')
2018-10-25 15:04:50 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:04:50 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-10-25 15:04:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 15:05:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 15:05:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 15:05:37 [DEBUG   ] Got command RPT from MCS: ref #268435
2018-10-25 15:05:37 [DEBUG   ] summary = ERROR
2018-10-25 15:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268435  13 58416 54337085 A  ERRORERROR'
2018-10-25 15:05:37 [DEBUG   ] Got command RPT from MCS: ref #268436
2018-10-25 15:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268436  84 58416 54337086 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:05:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:05:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 15:05:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:05:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:05:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:05:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:05:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:05:51 [DEBUG   ] Finished updating board flags in 2.180 seconds
2018-10-25 15:05:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 15:06:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:06:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:06:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:06:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:06:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:06:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:06:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:06:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:06:51 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-25 15:06:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:07:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 15:07:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:07:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:07:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:07:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:07:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:07:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:07:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:07:51 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-25 15:07:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:08:12 [DEBUG   ] Got command RPT from MCS: ref #268456
2018-10-25 15:08:12 [DEBUG   ] summary = ERROR
2018-10-25 15:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268456  13 58416 54492197 A  ERRORERROR'
2018-10-25 15:08:12 [DEBUG   ] Got command RPT from MCS: ref #268457
2018-10-25 15:08:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268457  84 58416 54492401 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:08:12 [DEBUG   ] Got command RPT from MCS: ref #268458
2018-10-25 15:08:12 [DEBUG   ] summary = ERROR
2018-10-25 15:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268458  13 58416 54492593 A  ERRORERROR'
2018-10-25 15:08:12 [DEBUG   ] Got command RPT from MCS: ref #268459
2018-10-25 15:08:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268459  84 58416 54492797 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:08:13 [DEBUG   ] Got command RPT from MCS: ref #268460
2018-10-25 15:08:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268460  12 58416 54493001 A  ERRORB–™š'
2018-10-25 15:08:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 15:08:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 15:08:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:08:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:08:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:08:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:08:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:08:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:08:51 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-25 15:08:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:09:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:09:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:09:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:09:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:09:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:09:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:09:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:09:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:09:51 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-25 15:09:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 15:10:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 15:10:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 15:10:37 [DEBUG   ] Got command RPT from MCS: ref #268465
2018-10-25 15:10:37 [DEBUG   ] summary = ERROR
2018-10-25 15:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268465  13 58416 54637081 A  ERRORERROR'
2018-10-25 15:10:37 [DEBUG   ] Got command RPT from MCS: ref #268466
2018-10-25 15:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268466  84 58416 54637082 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:10:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:10:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:10:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:10:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:10:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:10:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:10:51 [DEBUG   ] Finished updating board flags in 1.755 seconds
2018-10-25 15:10:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 15:11:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:11:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:11:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:11:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:11:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:11:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:11:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:11:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:11:51 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-25 15:11:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:12:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 15:12:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:12:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:12:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:12:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:12:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:12:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:12:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:12:51 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-25 15:12:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 15:13:12 [DEBUG   ] Got command RPT from MCS: ref #268484
2018-10-25 15:13:12 [DEBUG   ] summary = ERROR
2018-10-25 15:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268484  13 58416 54792277 A  ERRORERROR'
2018-10-25 15:13:12 [DEBUG   ] Got command RPT from MCS: ref #268485
2018-10-25 15:13:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268485  84 58416 54792481 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:13:12 [DEBUG   ] Got command RPT from MCS: ref #268486
2018-10-25 15:13:12 [DEBUG   ] summary = ERROR
2018-10-25 15:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268486  13 58416 54792685 A  ERRORERROR'
2018-10-25 15:13:12 [DEBUG   ] Got command RPT from MCS: ref #268488
2018-10-25 15:13:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268488  84 58416 54792889 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:13:13 [DEBUG   ] Got command RPT from MCS: ref #268490
2018-10-25 15:13:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268490  12 58416 54793081 A  ERRORB•™š'
2018-10-25 15:13:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:13:34 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-25 15:13:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:13:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:13:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:13:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:13:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:13:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:13:51 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-25 15:13:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:14:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 15:14:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:14:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:14:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:14:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:14:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:14:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:14:51 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-25 15:14:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-25 15:15:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:15:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:15:37 [DEBUG   ] Got command RPT from MCS: ref #268498
2018-10-25 15:15:37 [DEBUG   ] summary = ERROR
2018-10-25 15:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268498  13 58416 54937081 A  ERRORERROR'
2018-10-25 15:15:37 [DEBUG   ] Got command RPT from MCS: ref #268499
2018-10-25 15:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268499  84 58416 54937082 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:15:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:15:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:15:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:15:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:15:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:15:51 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-25 15:15:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 15:16:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 15:16:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 15:16:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:16:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:16:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:16:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:16:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:16:51 [WARNING ] (13, 1, 'bot')
2018-10-25 15:16:51 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:16:51 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-10-25 15:16:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 15:17:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 15:17:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 15:17:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:17:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:17:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:17:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:17:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:17:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:17:52 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-10-25 15:17:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:18:12 [DEBUG   ] Got command RPT from MCS: ref #268519
2018-10-25 15:18:12 [DEBUG   ] summary = ERROR
2018-10-25 15:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268519  13 58416 55092369 A  ERRORERROR'
2018-10-25 15:18:12 [DEBUG   ] Got command RPT from MCS: ref #268520
2018-10-25 15:18:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268520  84 58416 55092573 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:18:12 [DEBUG   ] Got command RPT from MCS: ref #268521
2018-10-25 15:18:12 [DEBUG   ] summary = ERROR
2018-10-25 15:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268521  13 58416 55092765 A  ERRORERROR'
2018-10-25 15:18:12 [DEBUG   ] Got command RPT from MCS: ref #268522
2018-10-25 15:18:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268522  84 58416 55092969 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:18:13 [DEBUG   ] Got command RPT from MCS: ref #268523
2018-10-25 15:18:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268523  12 58416 55093173 A  ERRORB˜™š'
2018-10-25 15:18:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:18:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:18:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:18:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:18:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:18:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:18:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:18:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:18:52 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-25 15:18:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:19:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:19:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:19:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:19:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:19:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:19:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:19:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:19:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:19:52 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-10-25 15:19:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:20:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:20:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:20:37 [DEBUG   ] Got command RPT from MCS: ref #268528
2018-10-25 15:20:37 [DEBUG   ] summary = ERROR
2018-10-25 15:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268528  13 58416 55237085 A  ERRORERROR'
2018-10-25 15:20:37 [DEBUG   ] Got command RPT from MCS: ref #268529
2018-10-25 15:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268529  84 58416 55237086 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:20:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:20:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:20:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:20:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:20:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:20:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:20:52 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-10-25 15:20:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 15:21:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:21:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:21:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 15:21:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:21:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:21:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:21:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:21:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:21:52 [DEBUG   ] Finished updating board flags in 1.897 seconds
2018-10-25 15:21:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:22:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:22:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:22:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:22:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:22:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:22:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:22:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:22:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:22:52 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-25 15:22:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:23:12 [DEBUG   ] Got command RPT from MCS: ref #268551
2018-10-25 15:23:12 [DEBUG   ] summary = ERROR
2018-10-25 15:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268551  13 58416 55392457 A  ERRORERROR'
2018-10-25 15:23:12 [DEBUG   ] Got command RPT from MCS: ref #268552
2018-10-25 15:23:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268552  84 58416 55392649 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:23:12 [DEBUG   ] Got command RPT from MCS: ref #268553
2018-10-25 15:23:12 [DEBUG   ] summary = ERROR
2018-10-25 15:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268553  13 58416 55392853 A  ERRORERROR'
2018-10-25 15:23:13 [DEBUG   ] Got command RPT from MCS: ref #268554
2018-10-25 15:23:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268554  84 58416 55393057 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:23:13 [DEBUG   ] Got command RPT from MCS: ref #268557
2018-10-25 15:23:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268557  12 58416 55393264 A  ERRORB—™š'
2018-10-25 15:23:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:23:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 15:23:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:23:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:23:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:23:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:23:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:23:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:23:52 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-25 15:23:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:24:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:24:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:24:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:24:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:24:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:24:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:24:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:24:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:24:52 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-10-25 15:24:55 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-25 15:25:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 15:25:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:25:37 [DEBUG   ] Got command RPT from MCS: ref #268565
2018-10-25 15:25:37 [DEBUG   ] summary = ERROR
2018-10-25 15:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268565  13 58416 55537089 A  ERRORERROR'
2018-10-25 15:25:37 [DEBUG   ] Got command RPT from MCS: ref #268566
2018-10-25 15:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268566  84 58416 55537090 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:25:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:25:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:25:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:25:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:25:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:25:52 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-25 15:25:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:26:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:26:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 15:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:26:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:26:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:26:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:26:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:26:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:26:52 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-10-25 15:26:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 15:27:16 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-25 15:27:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:27:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:27:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:27:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:27:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:27:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:27:52 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-10-25 15:27:55 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 15:28:12 [DEBUG   ] Got command RPT from MCS: ref #268582
2018-10-25 15:28:12 [DEBUG   ] summary = ERROR
2018-10-25 15:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268582  13 58416 55692537 A  ERRORERROR'
2018-10-25 15:28:12 [DEBUG   ] Got command RPT from MCS: ref #268583
2018-10-25 15:28:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268583  84 58416 55692741 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:28:12 [DEBUG   ] Got command RPT from MCS: ref #268584
2018-10-25 15:28:12 [DEBUG   ] summary = ERROR
2018-10-25 15:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268584  13 58416 55692945 A  ERRORERROR'
2018-10-25 15:28:13 [DEBUG   ] Got command RPT from MCS: ref #268585
2018-10-25 15:28:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268585  84 58416 55693149 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:28:13 [DEBUG   ] Got command RPT from MCS: ref #268586
2018-10-25 15:28:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268586  12 58416 55693341 A  ERRORB–™š'
2018-10-25 15:28:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-25 15:28:36 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-25 15:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:28:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:28:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:28:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:28:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:28:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:28:52 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-10-25 15:28:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 15:29:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 15:29:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:29:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:29:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:29:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:29:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:29:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:29:52 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-25 15:29:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:30:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:30:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:30:37 [DEBUG   ] Got command RPT from MCS: ref #268591
2018-10-25 15:30:37 [DEBUG   ] summary = ERROR
2018-10-25 15:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268591  13 58416 55837093 A  ERRORERROR'
2018-10-25 15:30:37 [DEBUG   ] Got command RPT from MCS: ref #268592
2018-10-25 15:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268592  84 58416 55837094 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:30:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:30:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:30:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:30:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:30:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:30:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:30:52 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-10-25 15:30:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:31:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:31:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:31:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:31:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:31:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:31:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:31:52 [WARNING ] (13, 1, 'bot')
2018-10-25 15:31:52 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:31:52 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-10-25 15:31:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:32:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:32:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:32:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:32:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:32:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:32:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:32:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:32:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:32:53 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-10-25 15:32:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:33:12 [DEBUG   ] Got command RPT from MCS: ref #268614
2018-10-25 15:33:12 [DEBUG   ] summary = ERROR
2018-10-25 15:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268614  13 58416 55992629 A  ERRORERROR'
2018-10-25 15:33:12 [DEBUG   ] Got command RPT from MCS: ref #268615
2018-10-25 15:33:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268615  84 58416 55992821 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:33:13 [DEBUG   ] Got command RPT from MCS: ref #268616
2018-10-25 15:33:13 [DEBUG   ] summary = ERROR
2018-10-25 15:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268616  13 58416 55993025 A  ERRORERROR'
2018-10-25 15:33:13 [DEBUG   ] Got command RPT from MCS: ref #268618
2018-10-25 15:33:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268618  84 58416 55993229 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:33:13 [DEBUG   ] Got command RPT from MCS: ref #268619
2018-10-25 15:33:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268619  12 58416 55993433 A  ERRORB•™š'
2018-10-25 15:33:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:33:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:33:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:33:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:33:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:33:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:33:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:33:53 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-10-25 15:33:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 15:34:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:34:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 15:34:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:34:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:34:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:34:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:34:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:34:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:34:53 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-10-25 15:34:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:35:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 15:35:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:35:37 [DEBUG   ] Got command RPT from MCS: ref #268628
2018-10-25 15:35:37 [DEBUG   ] summary = ERROR
2018-10-25 15:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268628  13 58416 56137085 A  ERRORERROR'
2018-10-25 15:35:37 [DEBUG   ] Got command RPT from MCS: ref #268629
2018-10-25 15:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268629  84 58416 56137086 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:35:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:35:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:35:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:35:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:35:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:35:53 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-25 15:35:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:36:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:36:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:36:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:36:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:36:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:36:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:36:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:36:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:36:53 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-10-25 15:36:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:37:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:37:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:37:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:37:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:37:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:37:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:37:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:37:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:37:53 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-25 15:37:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 15:38:12 [DEBUG   ] Got command RPT from MCS: ref #268649
2018-10-25 15:38:12 [DEBUG   ] summary = ERROR
2018-10-25 15:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268649  13 58416 56292717 A  ERRORERROR'
2018-10-25 15:38:12 [DEBUG   ] Got command RPT from MCS: ref #268650
2018-10-25 15:38:12 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268650  84 58416 56292909 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:38:13 [DEBUG   ] Got command RPT from MCS: ref #268651
2018-10-25 15:38:13 [DEBUG   ] summary = ERROR
2018-10-25 15:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268651  13 58416 56293113 A  ERRORERROR'
2018-10-25 15:38:13 [DEBUG   ] Got command RPT from MCS: ref #268652
2018-10-25 15:38:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268652  84 58416 56293317 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:38:13 [DEBUG   ] Got command RPT from MCS: ref #268653
2018-10-25 15:38:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268653  12 58416 56293509 A  ERRORB•™š'
2018-10-25 15:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:38:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:38:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:38:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:38:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:38:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:38:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:38:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:38:53 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-25 15:38:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 15:39:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:39:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:39:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:39:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:39:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:39:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:39:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:39:53 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-25 15:39:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:40:16 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2018-10-25 15:40:37 [DEBUG   ] Got command RPT from MCS: ref #268658
2018-10-25 15:40:37 [DEBUG   ] summary = ERROR
2018-10-25 15:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268658  13 58416 56437089 A  ERRORERROR'
2018-10-25 15:40:37 [DEBUG   ] Got command RPT from MCS: ref #268659
2018-10-25 15:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268659  84 58416 56437090 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:40:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 15:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:40:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:40:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:40:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:40:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:40:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:40:53 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-25 15:40:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 15:41:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 15:41:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:41:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 15:41:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:41:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:41:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:41:53 [WARNING ] (13, 1, 'bot')
2018-10-25 15:41:53 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:41:53 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-10-25 15:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:42:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:42:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:42:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:42:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:42:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:42:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:42:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:42:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:42:54 [DEBUG   ] Finished updating board flags in 2.141 seconds
2018-10-25 15:42:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 15:43:12 [DEBUG   ] Got command RPT from MCS: ref #268677
2018-10-25 15:43:12 [DEBUG   ] summary = ERROR
2018-10-25 15:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268677  13 58416 56592797 A  ERRORERROR'
2018-10-25 15:43:13 [DEBUG   ] Got command RPT from MCS: ref #268678
2018-10-25 15:43:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268678  84 58416 56593001 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:43:13 [DEBUG   ] Got command RPT from MCS: ref #268679
2018-10-25 15:43:13 [DEBUG   ] summary = ERROR
2018-10-25 15:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268679  13 58416 56593205 A  ERRORERROR'
2018-10-25 15:43:13 [DEBUG   ] Got command RPT from MCS: ref #268680
2018-10-25 15:43:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268680  84 58416 56593397 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:43:13 [DEBUG   ] Got command RPT from MCS: ref #268683
2018-10-25 15:43:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268683  12 58416 56593601 A  ERRORB•™š'
2018-10-25 15:43:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:43:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:43:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:43:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:43:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:43:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:43:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:43:54 [DEBUG   ] Finished updating board flags in 1.910 seconds
2018-10-25 15:43:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:44:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 15:44:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:44:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:44:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:44:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:44:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:44:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:44:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:44:54 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-25 15:44:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 15:45:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 15:45:37 [DEBUG   ] Got command RPT from MCS: ref #268691
2018-10-25 15:45:37 [DEBUG   ] summary = ERROR
2018-10-25 15:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268691  13 58416 56737093 A  ERRORERROR'
2018-10-25 15:45:37 [DEBUG   ] Got command RPT from MCS: ref #268692
2018-10-25 15:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268692  84 58416 56737094 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:45:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 15:45:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:45:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:45:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:45:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:45:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:45:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:45:54 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-25 15:45:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 15:46:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 15:46:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 15:46:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:46:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:46:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:46:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:46:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:46:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:46:54 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-25 15:46:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 15:47:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:47:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 15:47:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:47:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:47:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:47:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:47:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:47:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:47:54 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-10-25 15:47:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-25 15:48:12 [DEBUG   ] Got command RPT from MCS: ref #268712
2018-10-25 15:48:12 [DEBUG   ] summary = ERROR
2018-10-25 15:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268712  13 58416 56892881 A  ERRORERROR'
2018-10-25 15:48:13 [DEBUG   ] Got command RPT from MCS: ref #268713
2018-10-25 15:48:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268713  84 58416 56893085 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:48:13 [DEBUG   ] Got command RPT from MCS: ref #268714
2018-10-25 15:48:13 [DEBUG   ] summary = ERROR
2018-10-25 15:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268714  13 58416 56893289 A  ERRORERROR'
2018-10-25 15:48:13 [DEBUG   ] Got command RPT from MCS: ref #268715
2018-10-25 15:48:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268715  84 58416 56893481 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:48:13 [DEBUG   ] Got command RPT from MCS: ref #268716
2018-10-25 15:48:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268716  12 58416 56893685 A  ERRORB”™š'
2018-10-25 15:48:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:48:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 15:48:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:48:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:48:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:48:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:48:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:48:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:48:54 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-25 15:48:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 15:49:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 15:49:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 15:49:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:49:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:49:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:49:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:49:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:49:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:49:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:49:54 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-25 15:49:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 15:50:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 15:50:37 [DEBUG   ] Got command RPT from MCS: ref #268721
2018-10-25 15:50:37 [DEBUG   ] summary = ERROR
2018-10-25 15:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268721  13 58416 57037093 A  ERRORERROR'
2018-10-25 15:50:37 [DEBUG   ] Got command RPT from MCS: ref #268722
2018-10-25 15:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268722  84 58416 57037094 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:50:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 15:50:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:50:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:50:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:50:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:50:54 [WARNING ] (13, 1, 'bot')
2018-10-25 15:50:54 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:50:54 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-25 15:50:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 15:51:19 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2018-10-25 15:51:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:51:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:51:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:51:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:51:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:51:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:51:55 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-25 15:51:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:52:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:52:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 15:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:52:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:52:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:52:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:52:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:52:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:52:55 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-10-25 15:52:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:53:12 [DEBUG   ] Got command RPT from MCS: ref #268744
2018-10-25 15:53:12 [DEBUG   ] summary = ERROR
2018-10-25 15:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268744  13 58416 57192973 A  ERRORERROR'
2018-10-25 15:53:13 [DEBUG   ] Got command RPT from MCS: ref #268745
2018-10-25 15:53:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268745  84 58416 57193165 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:53:13 [DEBUG   ] Got command RPT from MCS: ref #268746
2018-10-25 15:53:13 [DEBUG   ] summary = ERROR
2018-10-25 15:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268746  13 58416 57193369 A  ERRORERROR'
2018-10-25 15:53:13 [DEBUG   ] Got command RPT from MCS: ref #268748
2018-10-25 15:53:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268748  84 58416 57193573 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:53:13 [DEBUG   ] Got command RPT from MCS: ref #268749
2018-10-25 15:53:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268749  12 58416 57193777 A  ERRORB—™š'
2018-10-25 15:53:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:53:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-25 15:53:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:53:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:53:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:53:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:53:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:53:55 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-25 15:53:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 15:54:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:54:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 15:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:54:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 15:54:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:54:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:54:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:54:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:54:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:54:55 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-25 15:54:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 15:55:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 15:55:37 [DEBUG   ] Got command RPT from MCS: ref #268758
2018-10-25 15:55:37 [DEBUG   ] summary = ERROR
2018-10-25 15:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268758  13 58416 57337097 A  ERRORERROR'
2018-10-25 15:55:37 [DEBUG   ] Got command RPT from MCS: ref #268759
2018-10-25 15:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268759  84 58416 57337098 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:55:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 15:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:55:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:55:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:55:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:55:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:55:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:55:55 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-25 15:56:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 15:56:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 15:56:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 15:56:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:56:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:56:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:56:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:56:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:56:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:56:55 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-25 15:57:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 15:57:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 15:57:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:57:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:57:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:57:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:57:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:57:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:57:55 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-25 15:58:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:58:13 [DEBUG   ] Got command RPT from MCS: ref #268775
2018-10-25 15:58:13 [DEBUG   ] summary = ERROR
2018-10-25 15:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268775  13 58416 57493057 A  ERRORERROR'
2018-10-25 15:58:13 [DEBUG   ] Got command RPT from MCS: ref #268776
2018-10-25 15:58:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268776  84 58416 57493261 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:58:13 [DEBUG   ] Got command RPT from MCS: ref #268777
2018-10-25 15:58:13 [DEBUG   ] summary = ERROR
2018-10-25 15:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268777  13 58416 57493453 A  ERRORERROR'
2018-10-25 15:58:13 [DEBUG   ] Got command RPT from MCS: ref #268778
2018-10-25 15:58:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 15:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268778  84 58416 57493657 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 15:58:13 [DEBUG   ] Got command RPT from MCS: ref #268779
2018-10-25 15:58:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 15:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268779  12 58416 57493861 A  ERRORB—™š'
2018-10-25 15:58:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:58:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 15:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 15:58:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:58:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:58:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:58:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:58:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:58:55 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-25 15:59:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 15:59:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:59:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 15:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 15:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 15:59:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:59:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:59:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:59:55 [WARNING ] (13, 1, 'bot')
2018-10-25 15:59:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 15:59:55 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-10-25 16:00:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 16:00:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 16:00:37 [DEBUG   ] Got command RPT from MCS: ref #268784
2018-10-25 16:00:37 [DEBUG   ] summary = ERROR
2018-10-25 16:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268784  13 58416 57637093 A  ERRORERROR'
2018-10-25 16:00:37 [DEBUG   ] Got command RPT from MCS: ref #268785
2018-10-25 16:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268785  84 58416 57637094 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:00:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 16:00:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 16:00:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:00:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:00:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:00:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:00:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:00:55 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-25 16:01:00 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-25 16:01:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:01:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 16:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:01:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:01:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:01:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:01:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:01:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:01:55 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-10-25 16:02:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:02:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 16:02:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 16:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:02:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:02:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:02:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:02:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:02:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:02:55 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-25 16:03:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:03:13 [DEBUG   ] Got command RPT from MCS: ref #268807
2018-10-25 16:03:13 [DEBUG   ] summary = ERROR
2018-10-25 16:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268807  13 58416 57793141 A  ERRORERROR'
2018-10-25 16:03:13 [DEBUG   ] Got command RPT from MCS: ref #268808
2018-10-25 16:03:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268808  84 58416 57793345 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:03:13 [DEBUG   ] Got command RPT from MCS: ref #268809
2018-10-25 16:03:13 [DEBUG   ] summary = ERROR
2018-10-25 16:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268809  13 58416 57793537 A  ERRORERROR'
2018-10-25 16:03:13 [DEBUG   ] Got command RPT from MCS: ref #268811
2018-10-25 16:03:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268811  84 58416 57793741 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:03:13 [DEBUG   ] Got command RPT from MCS: ref #268812
2018-10-25 16:03:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268812  12 58416 57793948 A  ERRORB–™š'
2018-10-25 16:03:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:03:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:03:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:03:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:03:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:03:55 [WARNING ] (13, 1, 'bot')
2018-10-25 16:03:55 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:03:55 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-10-25 16:04:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 16:04:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:04:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:04:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:04:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:04:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:04:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:04:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:04:56 [DEBUG   ] Finished updating board flags in 2.244 seconds
2018-10-25 16:05:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 16:05:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 16:05:37 [DEBUG   ] Got command RPT from MCS: ref #268821
2018-10-25 16:05:37 [DEBUG   ] summary = ERROR
2018-10-25 16:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268821  13 58416 57937097 A  ERRORERROR'
2018-10-25 16:05:37 [DEBUG   ] Got command RPT from MCS: ref #268822
2018-10-25 16:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268822  84 58416 57937098 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:05:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:05:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:05:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:05:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:05:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:05:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:05:56 [DEBUG   ] Finished updating board flags in 2.157 seconds
2018-10-25 16:06:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:06:21 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:06:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 16:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:06:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:06:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:06:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:06:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:06:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:06:56 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-10-25 16:07:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 16:07:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:07:42 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-25 16:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:07:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:07:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:07:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:07:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:07:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:07:56 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-25 16:08:02 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-25 16:08:13 [DEBUG   ] Got command RPT from MCS: ref #268842
2018-10-25 16:08:13 [DEBUG   ] summary = ERROR
2018-10-25 16:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268842  13 58416 58093229 A  ERRORERROR'
2018-10-25 16:08:13 [DEBUG   ] Got command RPT from MCS: ref #268843
2018-10-25 16:08:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268843  84 58416 58093433 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:08:13 [DEBUG   ] Got command RPT from MCS: ref #268844
2018-10-25 16:08:13 [DEBUG   ] summary = ERROR
2018-10-25 16:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268844  13 58416 58093625 A  ERRORERROR'
2018-10-25 16:08:13 [DEBUG   ] Got command RPT from MCS: ref #268845
2018-10-25 16:08:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268845  84 58416 58093829 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:08:14 [DEBUG   ] Got command RPT from MCS: ref #268846
2018-10-25 16:08:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268846  12 58416 58094033 A  ERRORB•™š'
2018-10-25 16:08:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:08:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:08:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:08:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:08:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:08:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:08:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:08:56 [DEBUG   ] Finished updating board flags in 1.904 seconds
2018-10-25 16:09:02 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-25 16:09:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:09:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:09:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:09:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:09:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:09:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:09:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:09:56 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-25 16:10:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:10:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 16:10:37 [DEBUG   ] Got command RPT from MCS: ref #268851
2018-10-25 16:10:37 [DEBUG   ] summary = ERROR
2018-10-25 16:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268851  13 58416 58237093 A  ERRORERROR'
2018-10-25 16:10:37 [DEBUG   ] Got command RPT from MCS: ref #268852
2018-10-25 16:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268852  84 58416 58237094 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:10:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:10:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:10:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:10:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:10:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:10:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:10:56 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-25 16:11:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:11:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:11:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 16:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:11:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:11:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:11:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:11:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:11:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:11:56 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-25 16:12:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:12:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:12:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:12:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:12:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:12:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:12:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:12:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:12:56 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-25 16:13:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 16:13:13 [DEBUG   ] Got command RPT from MCS: ref #268870
2018-10-25 16:13:13 [DEBUG   ] summary = ERROR
2018-10-25 16:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268870  13 58416 58393313 A  ERRORERROR'
2018-10-25 16:13:13 [DEBUG   ] Got command RPT from MCS: ref #268871
2018-10-25 16:13:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268871  84 58416 58393517 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:13:13 [DEBUG   ] Got command RPT from MCS: ref #268872
2018-10-25 16:13:13 [DEBUG   ] summary = ERROR
2018-10-25 16:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268872  13 58416 58393721 A  ERRORERROR'
2018-10-25 16:13:13 [DEBUG   ] Got command RPT from MCS: ref #268874
2018-10-25 16:13:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268874  84 58416 58393913 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:13:14 [DEBUG   ] Got command RPT from MCS: ref #268876
2018-10-25 16:13:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268876  12 58416 58394117 A  ERRORB•™š'
2018-10-25 16:13:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:13:43 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-25 16:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:13:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:13:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:13:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:13:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:13:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:13:56 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-25 16:14:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 16:14:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:14:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:14:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:14:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:14:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:14:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:14:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:14:56 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-25 16:15:03 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-25 16:15:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 16:15:37 [DEBUG   ] Got command RPT from MCS: ref #268884
2018-10-25 16:15:37 [DEBUG   ] summary = ERROR
2018-10-25 16:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268884  13 58416 58537097 A  ERRORERROR'
2018-10-25 16:15:37 [DEBUG   ] Got command RPT from MCS: ref #268885
2018-10-25 16:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268885  84 58416 58537098 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:15:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 16:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 16:15:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:15:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:15:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:15:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:15:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:15:56 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-25 16:16:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:16:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 16:16:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:16:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:16:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:16:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:16:56 [WARNING ] (13, 1, 'bot')
2018-10-25 16:16:56 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:16:56 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-25 16:17:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:17:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:17:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 16:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:17:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:17:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:17:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:17:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:17:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:17:57 [DEBUG   ] Finished updating board flags in 2.095 seconds
2018-10-25 16:18:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:18:13 [DEBUG   ] Got command RPT from MCS: ref #268905
2018-10-25 16:18:13 [DEBUG   ] summary = ERROR
2018-10-25 16:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268905  13 58416 58693405 A  ERRORERROR'
2018-10-25 16:18:13 [DEBUG   ] Got command RPT from MCS: ref #268906
2018-10-25 16:18:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268906  84 58416 58693609 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:18:13 [DEBUG   ] Got command RPT from MCS: ref #268907
2018-10-25 16:18:13 [DEBUG   ] summary = ERROR
2018-10-25 16:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268907  13 58416 58693801 A  ERRORERROR'
2018-10-25 16:18:14 [DEBUG   ] Got command RPT from MCS: ref #268908
2018-10-25 16:18:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268908  84 58416 58694005 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:18:14 [DEBUG   ] Got command RPT from MCS: ref #268909
2018-10-25 16:18:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268909  12 58416 58694209 A  ERRORB”™š'
2018-10-25 16:18:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:18:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:18:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:18:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:18:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:18:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:18:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:18:57 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-10-25 16:19:03 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-25 16:19:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:19:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 16:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:19:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:19:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:19:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:19:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:19:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:19:57 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-25 16:20:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-25 16:20:23 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-25 16:20:37 [DEBUG   ] Got command RPT from MCS: ref #268914
2018-10-25 16:20:37 [DEBUG   ] summary = ERROR
2018-10-25 16:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268914  13 58416 58837101 A  ERRORERROR'
2018-10-25 16:20:37 [DEBUG   ] Got command RPT from MCS: ref #268915
2018-10-25 16:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268915  84 58416 58837102 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:20:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 16:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:20:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:20:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:20:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:20:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:20:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:20:57 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-25 16:21:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:21:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:21:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 16:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:21:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:21:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:21:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:21:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:21:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:21:57 [DEBUG   ] Finished updating board flags in 1.640 seconds
2018-10-25 16:22:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 16:22:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 16:22:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 16:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:22:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:22:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:22:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:22:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:22:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:22:57 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-25 16:23:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:23:13 [DEBUG   ] Got command RPT from MCS: ref #268937
2018-10-25 16:23:13 [DEBUG   ] summary = ERROR
2018-10-25 16:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268937  13 58416 58993485 A  ERRORERROR'
2018-10-25 16:23:13 [DEBUG   ] Got command RPT from MCS: ref #268938
2018-10-25 16:23:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268938  84 58416 58993689 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:23:13 [DEBUG   ] Got command RPT from MCS: ref #268939
2018-10-25 16:23:13 [DEBUG   ] summary = ERROR
2018-10-25 16:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268939  13 58416 58993893 A  ERRORERROR'
2018-10-25 16:23:14 [DEBUG   ] Got command RPT from MCS: ref #268941
2018-10-25 16:23:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268941  84 58416 58994085 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:23:14 [DEBUG   ] Got command RPT from MCS: ref #268943
2018-10-25 16:23:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268943  12 58416 58994289 A  ERRORB—™š'
2018-10-25 16:23:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:23:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 16:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:23:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:23:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:23:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:23:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:23:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:23:57 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-25 16:24:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 16:24:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:24:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:24:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:24:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:24:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:24:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:24:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:24:57 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-25 16:25:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 16:25:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 16:25:37 [DEBUG   ] Got command RPT from MCS: ref #268951
2018-10-25 16:25:37 [DEBUG   ] summary = ERROR
2018-10-25 16:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268951  13 58416 59137101 A  ERRORERROR'
2018-10-25 16:25:37 [DEBUG   ] Got command RPT from MCS: ref #268952
2018-10-25 16:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268952  84 58416 59137102 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:25:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 16:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:25:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:25:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:25:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:25:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:25:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:25:57 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-25 16:26:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:26:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 16:26:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 16:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:26:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:26:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:26:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:26:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:26:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:26:57 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-25 16:27:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 16:27:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:27:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 16:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:27:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:27:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:27:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:27:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:27:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:27:57 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-10-25 16:28:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 16:28:13 [DEBUG   ] Got command RPT from MCS: ref #268968
2018-10-25 16:28:13 [DEBUG   ] summary = ERROR
2018-10-25 16:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268968  13 58416 59293577 A  ERRORERROR'
2018-10-25 16:28:13 [DEBUG   ] Got command RPT from MCS: ref #268969
2018-10-25 16:28:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268969  84 58416 59293769 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:28:13 [DEBUG   ] Got command RPT from MCS: ref #268970
2018-10-25 16:28:13 [DEBUG   ] summary = ERROR
2018-10-25 16:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268970  13 58416 59293973 A  ERRORERROR'
2018-10-25 16:28:14 [DEBUG   ] Got command RPT from MCS: ref #268971
2018-10-25 16:28:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268971  84 58416 59294177 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:28:14 [DEBUG   ] Got command RPT from MCS: ref #268972
2018-10-25 16:28:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268972  12 58416 59294381 A  ERRORB—™š'
2018-10-25 16:28:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:28:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:28:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:28:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:28:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:28:57 [WARNING ] (13, 1, 'bot')
2018-10-25 16:28:57 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:28:57 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-25 16:29:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 16:29:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 16:29:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:29:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:29:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:29:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:29:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:29:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:29:58 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-10-25 16:30:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:30:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:30:37 [DEBUG   ] Got command RPT from MCS: ref #268977
2018-10-25 16:30:37 [DEBUG   ] summary = ERROR
2018-10-25 16:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268977  13 58416 59437101 A  ERRORERROR'
2018-10-25 16:30:37 [DEBUG   ] Got command RPT from MCS: ref #268978
2018-10-25 16:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   268978  84 58416 59437102 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:30:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 16:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:30:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:30:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:30:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:30:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:30:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:30:58 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-25 16:31:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 16:31:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:31:46 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2018-10-25 16:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:31:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:31:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:31:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:31:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:31:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:31:58 [DEBUG   ] Finished updating board flags in 1.909 seconds
2018-10-25 16:32:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 16:32:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 16:32:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 16:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:32:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:32:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:32:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:32:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:32:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:32:58 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-25 16:33:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:33:13 [DEBUG   ] Got command RPT from MCS: ref #269000
2018-10-25 16:33:13 [DEBUG   ] summary = ERROR
2018-10-25 16:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269000  13 58416 59593661 A  ERRORERROR'
2018-10-25 16:33:13 [DEBUG   ] Got command RPT from MCS: ref #269001
2018-10-25 16:33:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269001  84 58416 59593865 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:33:14 [DEBUG   ] Got command RPT from MCS: ref #269002
2018-10-25 16:33:14 [DEBUG   ] summary = ERROR
2018-10-25 16:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269002  13 58416 59594057 A  ERRORERROR'
2018-10-25 16:33:14 [DEBUG   ] Got command RPT from MCS: ref #269004
2018-10-25 16:33:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269004  84 58416 59594261 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:33:14 [DEBUG   ] Got command RPT from MCS: ref #269006
2018-10-25 16:33:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269006  12 58416 59594465 A  ERRORB–™š'
2018-10-25 16:33:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:33:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 16:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:33:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:33:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:33:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:33:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:33:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:33:58 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-25 16:34:06 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-10-25 16:34:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:34:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:34:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:34:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:34:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:34:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:34:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:34:58 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-25 16:35:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 16:35:26 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-25 16:35:37 [DEBUG   ] Got command RPT from MCS: ref #269014
2018-10-25 16:35:37 [DEBUG   ] summary = ERROR
2018-10-25 16:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269014  13 58416 59737101 A  ERRORERROR'
2018-10-25 16:35:37 [DEBUG   ] Got command RPT from MCS: ref #269015
2018-10-25 16:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269015  84 58416 59737102 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:35:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:35:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:35:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:35:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:35:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:35:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:35:58 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-25 16:36:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:36:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:36:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 16:36:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:36:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 16:36:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:36:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:36:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:36:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:36:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:36:58 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-25 16:37:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:37:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:37:46 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-25 16:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:37:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:37:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:37:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:37:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:37:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:37:58 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-25 16:38:07 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 16:38:13 [DEBUG   ] Got command RPT from MCS: ref #269035
2018-10-25 16:38:13 [DEBUG   ] summary = ERROR
2018-10-25 16:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269035  13 58416 59893741 A  ERRORERROR'
2018-10-25 16:38:13 [DEBUG   ] Got command RPT from MCS: ref #269036
2018-10-25 16:38:13 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269036  84 58416 59893949 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:38:14 [DEBUG   ] Got command RPT from MCS: ref #269037
2018-10-25 16:38:14 [DEBUG   ] summary = ERROR
2018-10-25 16:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269037  13 58416 59894153 A  ERRORERROR'
2018-10-25 16:38:14 [DEBUG   ] Got command RPT from MCS: ref #269038
2018-10-25 16:38:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269038  84 58416 59894358 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:38:14 [DEBUG   ] Got command RPT from MCS: ref #269039
2018-10-25 16:38:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269039  12 58416 59894549 A  ERRORB•™š'
2018-10-25 16:38:27 [DEBUG   ] Finished updating ant stats in 1.181 seconds
2018-10-25 16:38:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 16:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:38:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:38:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:38:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:38:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:38:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:38:58 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-10-25 16:39:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:39:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:39:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:39:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:39:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:39:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:39:58 [WARNING ] (13, 1, 'bot')
2018-10-25 16:39:58 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:39:58 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-25 16:40:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 16:40:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:40:37 [DEBUG   ] Got command RPT from MCS: ref #269044
2018-10-25 16:40:37 [DEBUG   ] summary = ERROR
2018-10-25 16:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269044  13 58416 60037101 A  ERRORERROR'
2018-10-25 16:40:37 [DEBUG   ] Got command RPT from MCS: ref #269045
2018-10-25 16:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269045  84 58416 60037102 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:40:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:40:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:40:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:40:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:40:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:40:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:40:59 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-10-25 16:41:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:41:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 16:41:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 16:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 16:41:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:41:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:41:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:41:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:41:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:41:59 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-25 16:42:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:42:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 16:42:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 16:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:42:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:42:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:42:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:42:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:42:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:42:59 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-25 16:43:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:43:13 [DEBUG   ] Got command RPT from MCS: ref #269063
2018-10-25 16:43:13 [DEBUG   ] summary = ERROR
2018-10-25 16:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269063  13 58416 60193833 A  ERRORERROR'
2018-10-25 16:43:14 [DEBUG   ] Got command RPT from MCS: ref #269064
2018-10-25 16:43:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269064  84 58416 60194037 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:43:14 [DEBUG   ] Got command RPT from MCS: ref #269065
2018-10-25 16:43:14 [DEBUG   ] summary = ERROR
2018-10-25 16:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269065  13 58416 60194229 A  ERRORERROR'
2018-10-25 16:43:14 [DEBUG   ] Got command RPT from MCS: ref #269067
2018-10-25 16:43:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269067  84 58416 60194433 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:43:14 [DEBUG   ] Got command RPT from MCS: ref #269068
2018-10-25 16:43:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269068  12 58416 60194637 A  ERRORB•™š'
2018-10-25 16:43:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:43:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 16:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:43:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:43:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:43:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:43:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:43:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:43:59 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 16:44:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:44:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:44:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 16:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:44:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:44:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:44:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:44:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:44:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:44:59 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-25 16:45:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 16:45:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:45:37 [DEBUG   ] Got command RPT from MCS: ref #269077
2018-10-25 16:45:37 [DEBUG   ] summary = ERROR
2018-10-25 16:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269077  13 58416 60337105 A  ERRORERROR'
2018-10-25 16:45:37 [DEBUG   ] Got command RPT from MCS: ref #269078
2018-10-25 16:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269078  84 58416 60337106 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:45:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:45:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:45:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:45:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:45:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:45:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:45:59 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-25 16:46:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:46:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 16:46:48 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-10-25 16:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:46:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:46:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:46:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:46:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:46:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:46:59 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-25 16:47:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:47:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 16:47:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 16:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:47:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:47:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:47:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:47:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:47:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:47:59 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-25 16:48:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:48:13 [DEBUG   ] Got command RPT from MCS: ref #269098
2018-10-25 16:48:13 [DEBUG   ] summary = ERROR
2018-10-25 16:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269098  13 58416 60493917 A  ERRORERROR'
2018-10-25 16:48:14 [DEBUG   ] Got command RPT from MCS: ref #269099
2018-10-25 16:48:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269099  84 58416 60494121 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:48:14 [DEBUG   ] Got command RPT from MCS: ref #269100
2018-10-25 16:48:14 [DEBUG   ] summary = ERROR
2018-10-25 16:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269100  13 58416 60494325 A  ERRORERROR'
2018-10-25 16:48:14 [DEBUG   ] Got command RPT from MCS: ref #269101
2018-10-25 16:48:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269101  84 58416 60494529 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:48:14 [DEBUG   ] Got command RPT from MCS: ref #269102
2018-10-25 16:48:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269102  12 58416 60494721 A  ERRORB”™š'
2018-10-25 16:48:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 16:48:49 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-25 16:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:48:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:48:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:48:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:48:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:48:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:48:59 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-25 16:49:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:49:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 16:49:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 16:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 16:49:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:49:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:49:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:49:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:49:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:49:59 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-25 16:50:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 16:50:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:50:37 [DEBUG   ] Got command RPT from MCS: ref #269107
2018-10-25 16:50:37 [DEBUG   ] summary = ERROR
2018-10-25 16:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269107  13 58416 60637105 A  ERRORERROR'
2018-10-25 16:50:37 [DEBUG   ] Got command RPT from MCS: ref #269108
2018-10-25 16:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269108  84 58416 60637106 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:50:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 16:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:50:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:50:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:50:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:50:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:50:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:50:59 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-25 16:51:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 16:51:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 16:51:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 16:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:51:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:51:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:51:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:51:59 [WARNING ] (13, 1, 'bot')
2018-10-25 16:51:59 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:51:59 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-25 16:52:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:52:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:52:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 16:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:53:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:53:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:53:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:53:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:53:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:53:00 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-10-25 16:53:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 16:53:14 [DEBUG   ] Got command RPT from MCS: ref #269130
2018-10-25 16:53:14 [DEBUG   ] summary = ERROR
2018-10-25 16:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269130  13 58416 60794001 A  ERRORERROR'
2018-10-25 16:53:14 [DEBUG   ] Got command RPT from MCS: ref #269131
2018-10-25 16:53:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269131  84 58416 60794205 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:53:14 [DEBUG   ] Got command RPT from MCS: ref #269132
2018-10-25 16:53:14 [DEBUG   ] summary = ERROR
2018-10-25 16:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269132  13 58416 60794409 A  ERRORERROR'
2018-10-25 16:53:14 [DEBUG   ] Got command RPT from MCS: ref #269134
2018-10-25 16:53:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269134  84 58416 60794613 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:53:14 [DEBUG   ] Got command RPT from MCS: ref #269135
2018-10-25 16:53:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269135  12 58416 60794805 A  ERRORB”™š'
2018-10-25 16:53:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 16:53:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 16:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:54:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:54:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:54:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:54:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:54:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:54:00 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-25 16:54:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 16:54:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 16:54:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 16:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:55:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:55:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:55:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:55:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:55:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:55:00 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-10-25 16:55:09 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 16:55:29 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-25 16:55:37 [DEBUG   ] Got command RPT from MCS: ref #269144
2018-10-25 16:55:37 [DEBUG   ] summary = ERROR
2018-10-25 16:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269144  13 58416 60937113 A  ERRORERROR'
2018-10-25 16:55:37 [DEBUG   ] Got command RPT from MCS: ref #269145
2018-10-25 16:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269145  84 58416 60937114 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:55:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 16:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:56:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:56:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:56:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:56:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:56:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:56:00 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 16:56:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 16:56:30 [DEBUG   ] Finished updating ant stats in 0.982 seconds
2018-10-25 16:56:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 16:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:57:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:57:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:57:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:57:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:57:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:57:00 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-25 16:57:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 16:57:30 [DEBUG   ] Finished updating ant stats in 0.785 seconds
2018-10-25 16:57:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 16:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:58:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:58:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:58:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:58:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:58:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:58:00 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-25 16:58:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:58:14 [DEBUG   ] Got command RPT from MCS: ref #269161
2018-10-25 16:58:14 [DEBUG   ] summary = ERROR
2018-10-25 16:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269161  13 58416 61094089 A  ERRORERROR'
2018-10-25 16:58:14 [DEBUG   ] Got command RPT from MCS: ref #269162
2018-10-25 16:58:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269162  84 58416 61094293 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:58:14 [DEBUG   ] Got command RPT from MCS: ref #269163
2018-10-25 16:58:14 [DEBUG   ] summary = ERROR
2018-10-25 16:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269163  13 58416 61094497 A  ERRORERROR'
2018-10-25 16:58:14 [DEBUG   ] Got command RPT from MCS: ref #269164
2018-10-25 16:58:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 16:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269164  84 58416 61094689 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 16:58:14 [DEBUG   ] Got command RPT from MCS: ref #269165
2018-10-25 16:58:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 16:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269165  12 58416 61094894 A  ERRORB—™š'
2018-10-25 16:58:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 16:58:51 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-25 16:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 16:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-25 16:59:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:59:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:59:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:59:00 [WARNING ] (13, 1, 'bot')
2018-10-25 16:59:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 16:59:00 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-10-25 16:59:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 16:59:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 16:59:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 17:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:00:00 [WARNING ] (13, 1, 'bot')
2018-10-25 17:00:00 [WARNING ] (13, 1, 'bot')
2018-10-25 17:00:00 [WARNING ] (13, 1, 'bot')
2018-10-25 17:00:00 [WARNING ] (13, 1, 'bot')
2018-10-25 17:00:00 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:00:00 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-25 17:00:11 [DEBUG   ] Finished updating ant stats in 1.388 seconds
2018-10-25 17:00:31 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-25 17:00:37 [DEBUG   ] Got command RPT from MCS: ref #269170
2018-10-25 17:00:37 [DEBUG   ] summary = ERROR
2018-10-25 17:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269170  13 58416 61237109 A  ERRORERROR'
2018-10-25 17:00:37 [DEBUG   ] Got command RPT from MCS: ref #269171
2018-10-25 17:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269171  84 58416 61237110 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:00:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 17:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:01:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:01:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:01:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:01:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:01:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:01:01 [DEBUG   ] Finished updating board flags in 2.225 seconds
2018-10-25 17:01:11 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-25 17:01:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:01:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 17:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:02:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:02:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:02:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:02:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:02:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:02:01 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-10-25 17:02:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 17:02:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 17:02:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 17:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:03:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:03:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:03:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:03:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:03:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:03:01 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-25 17:03:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:03:14 [DEBUG   ] Got command RPT from MCS: ref #269193
2018-10-25 17:03:14 [DEBUG   ] summary = ERROR
2018-10-25 17:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269193  13 58416 61394173 A  ERRORERROR'
2018-10-25 17:03:14 [DEBUG   ] Got command RPT from MCS: ref #269194
2018-10-25 17:03:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269194  84 58416 61394378 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:03:14 [DEBUG   ] Got command RPT from MCS: ref #269195
2018-10-25 17:03:14 [DEBUG   ] summary = ERROR
2018-10-25 17:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269195  13 58416 61394581 A  ERRORERROR'
2018-10-25 17:03:14 [DEBUG   ] Got command RPT from MCS: ref #269197
2018-10-25 17:03:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269197  84 58416 61394773 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:03:14 [DEBUG   ] Got command RPT from MCS: ref #269198
2018-10-25 17:03:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269198  12 58416 61394977 A  ERRORB—™š'
2018-10-25 17:03:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 17:03:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 17:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 17:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:04:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:04:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:04:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:04:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:04:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:04:01 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-25 17:04:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 17:04:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:04:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:05:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:05:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:05:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:05:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:05:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:05:01 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-10-25 17:05:11 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-25 17:05:32 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-25 17:05:37 [DEBUG   ] Got command RPT from MCS: ref #269207
2018-10-25 17:05:37 [DEBUG   ] summary = ERROR
2018-10-25 17:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269207  13 58416 61537113 A  ERRORERROR'
2018-10-25 17:05:37 [DEBUG   ] Got command RPT from MCS: ref #269208
2018-10-25 17:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269208  84 58416 61537114 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:05:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 17:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:06:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:06:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:06:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:06:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:06:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:06:01 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-25 17:06:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 17:06:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:06:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 17:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:07:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:07:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:07:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:07:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:07:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:07:01 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-10-25 17:07:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 17:07:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 17:07:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 17:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:08:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:08:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:08:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:08:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:08:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:08:01 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-25 17:08:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 17:08:14 [DEBUG   ] Got command RPT from MCS: ref #269228
2018-10-25 17:08:14 [DEBUG   ] summary = ERROR
2018-10-25 17:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269228  13 58416 61694265 A  ERRORERROR'
2018-10-25 17:08:14 [DEBUG   ] Got command RPT from MCS: ref #269229
2018-10-25 17:08:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269229  84 58416 61694457 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:08:14 [DEBUG   ] Got command RPT from MCS: ref #269230
2018-10-25 17:08:14 [DEBUG   ] summary = ERROR
2018-10-25 17:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269230  13 58416 61694661 A  ERRORERROR'
2018-10-25 17:08:14 [DEBUG   ] Got command RPT from MCS: ref #269231
2018-10-25 17:08:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269231  84 58416 61694865 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:08:15 [DEBUG   ] Got command RPT from MCS: ref #269232
2018-10-25 17:08:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269232  12 58416 61695069 A  ERRORB–™š'
2018-10-25 17:08:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:08:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 17:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:09:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:09:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:09:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:09:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:09:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:09:01 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-25 17:09:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 17:09:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 17:09:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 17:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:10:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:10:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:10:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:10:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:10:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:10:01 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-25 17:10:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 17:10:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 17:10:37 [DEBUG   ] Got command RPT from MCS: ref #269237
2018-10-25 17:10:37 [DEBUG   ] summary = ERROR
2018-10-25 17:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269237  13 58416 61837109 A  ERRORERROR'
2018-10-25 17:10:37 [DEBUG   ] Got command RPT from MCS: ref #269238
2018-10-25 17:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269238  84 58416 61837110 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:10:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 17:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:11:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:11:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:11:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:11:01 [WARNING ] (13, 1, 'bot')
2018-10-25 17:11:01 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:11:01 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-25 17:11:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 17:11:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 17:11:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:12:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:12:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:12:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:12:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:12:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:12:02 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-10-25 17:12:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:12:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 17:12:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 17:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:13:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:13:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:13:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:13:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:13:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:13:02 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-10-25 17:13:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:13:14 [DEBUG   ] Got command RPT from MCS: ref #269256
2018-10-25 17:13:14 [DEBUG   ] summary = ERROR
2018-10-25 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269256  13 58416 61994345 A  ERRORERROR'
2018-10-25 17:13:14 [DEBUG   ] Got command RPT from MCS: ref #269257
2018-10-25 17:13:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269257  84 58416 61994549 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:13:14 [DEBUG   ] Got command RPT from MCS: ref #269258
2018-10-25 17:13:14 [DEBUG   ] summary = ERROR
2018-10-25 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269258  13 58416 61994741 A  ERRORERROR'
2018-10-25 17:13:14 [DEBUG   ] Got command RPT from MCS: ref #269259
2018-10-25 17:13:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269259  84 58416 61994945 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:13:15 [DEBUG   ] Got command RPT from MCS: ref #269261
2018-10-25 17:13:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269261  12 58416 61995149 A  ERRORB–™š'
2018-10-25 17:13:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:13:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:14:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:14:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:14:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:14:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:14:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:14:02 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-25 17:14:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:14:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:14:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 17:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:15:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:15:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:15:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:15:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:15:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:15:02 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-25 17:15:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 17:15:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 17:15:37 [DEBUG   ] Got command RPT from MCS: ref #269270
2018-10-25 17:15:37 [DEBUG   ] summary = ERROR
2018-10-25 17:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269270  13 58416 62137117 A  ERRORERROR'
2018-10-25 17:15:37 [DEBUG   ] Got command RPT from MCS: ref #269271
2018-10-25 17:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269271  84 58416 62137118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:15:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 17:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:16:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:16:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:16:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:16:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:16:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:16:02 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-10-25 17:16:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 17:16:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:16:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:17:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:17:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:17:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:17:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:17:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:17:02 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-25 17:17:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 17:17:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 17:17:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:18:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:18:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:18:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:18:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:18:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:18:02 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-25 17:18:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:18:14 [DEBUG   ] Got command RPT from MCS: ref #269291
2018-10-25 17:18:14 [DEBUG   ] summary = ERROR
2018-10-25 17:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269291  13 58416 62294429 A  ERRORERROR'
2018-10-25 17:18:14 [DEBUG   ] Got command RPT from MCS: ref #269292
2018-10-25 17:18:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269292  84 58416 62294633 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:18:14 [DEBUG   ] Got command RPT from MCS: ref #269293
2018-10-25 17:18:14 [DEBUG   ] summary = ERROR
2018-10-25 17:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269293  13 58416 62294837 A  ERRORERROR'
2018-10-25 17:18:15 [DEBUG   ] Got command RPT from MCS: ref #269294
2018-10-25 17:18:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269294  84 58416 62295029 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:18:15 [DEBUG   ] Got command RPT from MCS: ref #269295
2018-10-25 17:18:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269295  12 58416 62295233 A  ERRORB•™š'
2018-10-25 17:18:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:18:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 17:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:19:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:19:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:19:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:19:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:19:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:19:02 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-25 17:19:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 17:19:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 17:19:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:20:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:20:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:20:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:20:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:20:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:20:02 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-25 17:20:14 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-25 17:20:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 17:20:37 [DEBUG   ] Got command RPT from MCS: ref #269300
2018-10-25 17:20:37 [DEBUG   ] summary = ERROR
2018-10-25 17:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269300  13 58416 62437117 A  ERRORERROR'
2018-10-25 17:20:37 [DEBUG   ] Got command RPT from MCS: ref #269301
2018-10-25 17:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269301  84 58416 62437118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:20:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 17:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:21:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:21:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:21:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:21:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:21:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:21:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:21:02 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-10-25 17:21:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 17:21:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 17:21:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 17:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:22:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:22:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:22:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:22:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:22:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:22:02 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-25 17:22:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 17:22:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:22:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 17:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:23:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:23:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:23:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:23:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:23:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:23:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:23:02 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-25 17:23:14 [DEBUG   ] Got command RPT from MCS: ref #269323
2018-10-25 17:23:14 [DEBUG   ] summary = ERROR
2018-10-25 17:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269323  13 58416 62594521 A  ERRORERROR'
2018-10-25 17:23:14 [DEBUG   ] Got command RPT from MCS: ref #269324
2018-10-25 17:23:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269324  84 58416 62594717 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:23:14 [DEBUG   ] Got command RPT from MCS: ref #269325
2018-10-25 17:23:14 [DEBUG   ] summary = ERROR
2018-10-25 17:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269325  13 58416 62594921 A  ERRORERROR'
2018-10-25 17:23:15 [DEBUG   ] Got command RPT from MCS: ref #269327
2018-10-25 17:23:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269327  84 58416 62595113 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:23:15 [DEBUG   ] Got command RPT from MCS: ref #269328
2018-10-25 17:23:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269328  12 58416 62595317 A  ERRORB•™š'
2018-10-25 17:23:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 17:23:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 17:23:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 17:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:24:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:24:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:24:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:24:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:24:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:24:02 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-25 17:24:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:24:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 17:24:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 17:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:25:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:25:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:25:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:25:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:25:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:25:02 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-25 17:25:16 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-25 17:25:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:25:37 [DEBUG   ] Got command RPT from MCS: ref #269337
2018-10-25 17:25:37 [DEBUG   ] summary = ERROR
2018-10-25 17:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269337  13 58416 62737117 A  ERRORERROR'
2018-10-25 17:25:37 [DEBUG   ] Got command RPT from MCS: ref #269338
2018-10-25 17:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269338  84 58416 62737118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:25:56 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-25 17:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:26:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:26:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:26:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:26:02 [WARNING ] (13, 1, 'bot')
2018-10-25 17:26:02 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:26:02 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-25 17:26:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:26:36 [DEBUG   ] Finished updating ant stats in 1.605 seconds
2018-10-25 17:26:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 17:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:27:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:27:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:27:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:27:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:27:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:27:03 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-10-25 17:27:15 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-25 17:27:35 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-25 17:27:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 17:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:28:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:28:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:28:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:28:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:28:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:28:03 [DEBUG   ] Finished updating board flags in 1.950 seconds
2018-10-25 17:28:14 [DEBUG   ] Got command RPT from MCS: ref #269354
2018-10-25 17:28:14 [DEBUG   ] summary = ERROR
2018-10-25 17:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269354  13 58416 62894598 A  ERRORERROR'
2018-10-25 17:28:14 [DEBUG   ] Got command RPT from MCS: ref #269355
2018-10-25 17:28:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269355  84 58416 62894801 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:28:15 [DEBUG   ] Got command RPT from MCS: ref #269356
2018-10-25 17:28:15 [DEBUG   ] summary = ERROR
2018-10-25 17:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269356  13 58416 62895005 A  ERRORERROR'
2018-10-25 17:28:15 [DEBUG   ] Got command RPT from MCS: ref #269357
2018-10-25 17:28:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269357  84 58416 62895210 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:28:15 [DEBUG   ] Got command RPT from MCS: ref #269358
2018-10-25 17:28:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269358  12 58416 62895402 A  ERRORB”™š'
2018-10-25 17:28:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 17:28:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 17:28:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 17:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:29:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:29:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:29:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:29:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:29:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:29:03 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-25 17:29:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 17:29:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:29:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 17:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:30:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:30:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:30:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:30:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:30:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:30:03 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-25 17:30:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:30:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 17:30:37 [DEBUG   ] Got command RPT from MCS: ref #269363
2018-10-25 17:30:37 [DEBUG   ] summary = ERROR
2018-10-25 17:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269363  13 58416 63037117 A  ERRORERROR'
2018-10-25 17:30:37 [DEBUG   ] Got command RPT from MCS: ref #269364
2018-10-25 17:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269364  84 58416 63037118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:30:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 17:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:31:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:31:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:31:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:31:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:31:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:31:03 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-25 17:31:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-25 17:31:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 17:31:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 17:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:32:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:32:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:32:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:32:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:32:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:32:03 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-25 17:32:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 17:32:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 17:32:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:33:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:33:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:33:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:33:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:33:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:33:03 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-25 17:33:14 [DEBUG   ] Got command RPT from MCS: ref #269386
2018-10-25 17:33:14 [DEBUG   ] summary = ERROR
2018-10-25 17:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269386  13 58416 63194689 A  ERRORERROR'
2018-10-25 17:33:14 [DEBUG   ] Got command RPT from MCS: ref #269387
2018-10-25 17:33:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269387  84 58416 63194893 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:33:15 [DEBUG   ] Got command RPT from MCS: ref #269388
2018-10-25 17:33:15 [DEBUG   ] summary = ERROR
2018-10-25 17:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269388  13 58416 63195085 A  ERRORERROR'
2018-10-25 17:33:15 [DEBUG   ] Got command RPT from MCS: ref #269390
2018-10-25 17:33:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269390  84 58416 63195289 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:33:15 [DEBUG   ] Got command RPT from MCS: ref #269392
2018-10-25 17:33:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269392  12 58416 63195493 A  ERRORB”™š'
2018-10-25 17:33:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 17:33:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 17:33:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:34:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:34:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:34:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:34:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:34:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:34:03 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-25 17:34:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:34:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:34:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 17:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:35:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:35:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:35:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:35:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:35:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:35:03 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-25 17:35:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:35:37 [DEBUG   ] Got command RPT from MCS: ref #269400
2018-10-25 17:35:37 [DEBUG   ] summary = ERROR
2018-10-25 17:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269400  13 58416 63337117 A  ERRORERROR'
2018-10-25 17:35:37 [DEBUG   ] Got command RPT from MCS: ref #269401
2018-10-25 17:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269401  84 58416 63337118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:35:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 17:35:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 17:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:36:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:36:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:36:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:36:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:36:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:36:03 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-25 17:36:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 17:36:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 17:36:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 17:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:37:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:37:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:37:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:37:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:37:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:37:03 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-10-25 17:37:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 17:37:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 17:37:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 17:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:38:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:38:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:38:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:38:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:38:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:38:03 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-25 17:38:14 [DEBUG   ] Got command RPT from MCS: ref #269421
2018-10-25 17:38:14 [DEBUG   ] summary = ERROR
2018-10-25 17:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269421  13 58416 63494773 A  ERRORERROR'
2018-10-25 17:38:14 [DEBUG   ] Got command RPT from MCS: ref #269422
2018-10-25 17:38:14 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269422  84 58416 63494977 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:38:15 [DEBUG   ] Got command RPT from MCS: ref #269423
2018-10-25 17:38:15 [DEBUG   ] summary = ERROR
2018-10-25 17:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269423  13 58416 63495181 A  ERRORERROR'
2018-10-25 17:38:15 [DEBUG   ] Got command RPT from MCS: ref #269424
2018-10-25 17:38:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269424  84 58416 63495373 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:38:15 [DEBUG   ] Got command RPT from MCS: ref #269425
2018-10-25 17:38:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269425  12 58416 63495577 A  ERRORB•™š'
2018-10-25 17:38:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 17:38:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 17:38:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-25 17:39:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:39:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:39:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:39:03 [WARNING ] (13, 1, 'bot')
2018-10-25 17:39:03 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:39:03 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-10-25 17:39:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 17:39:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 17:39:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 17:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:40:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:40:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:40:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:40:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:40:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:40:04 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-10-25 17:40:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:40:37 [DEBUG   ] Got command RPT from MCS: ref #269430
2018-10-25 17:40:37 [DEBUG   ] summary = ERROR
2018-10-25 17:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269430  13 58416 63637125 A  ERRORERROR'
2018-10-25 17:40:37 [DEBUG   ] Got command RPT from MCS: ref #269431
2018-10-25 17:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269431  84 58416 63637126 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:40:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:40:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 17:41:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 17:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:41:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:41:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:41:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:41:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:41:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:41:04 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-10-25 17:41:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 17:41:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:41:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:42:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:42:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:42:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:42:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:42:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:42:04 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-10-25 17:42:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 17:42:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 17:42:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 17:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:43:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:43:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:43:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:43:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:43:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:43:04 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-25 17:43:14 [DEBUG   ] Got command RPT from MCS: ref #269449
2018-10-25 17:43:14 [DEBUG   ] summary = ERROR
2018-10-25 17:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269449  13 58416 63794857 A  ERRORERROR'
2018-10-25 17:43:15 [DEBUG   ] Got command RPT from MCS: ref #269450
2018-10-25 17:43:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269450  84 58416 63795061 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:43:15 [DEBUG   ] Got command RPT from MCS: ref #269451
2018-10-25 17:43:15 [DEBUG   ] summary = ERROR
2018-10-25 17:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269451  13 58416 63795265 A  ERRORERROR'
2018-10-25 17:43:15 [DEBUG   ] Got command RPT from MCS: ref #269453
2018-10-25 17:43:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269453  84 58416 63795457 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:43:15 [DEBUG   ] Got command RPT from MCS: ref #269454
2018-10-25 17:43:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269454  12 58416 63795661 A  ERRORB—™š'
2018-10-25 17:43:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 17:43:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 17:43:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 17:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 17:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:44:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:44:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:44:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:44:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:44:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:44:04 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-25 17:44:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 17:44:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 17:44:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 17:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 17:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:45:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:45:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:45:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:45:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:45:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:45:04 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-25 17:45:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 17:45:37 [DEBUG   ] Got command RPT from MCS: ref #269463
2018-10-25 17:45:37 [DEBUG   ] summary = ERROR
2018-10-25 17:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269463  13 58416 63937117 A  ERRORERROR'
2018-10-25 17:45:37 [DEBUG   ] Got command RPT from MCS: ref #269464
2018-10-25 17:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269464  84 58416 63937118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:45:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 17:45:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 17:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:46:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:46:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:46:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:46:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:46:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:46:04 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-25 17:46:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 17:46:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 17:46:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:47:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:47:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:47:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:47:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:47:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:47:04 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-25 17:47:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 17:47:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 17:48:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 17:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:48:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:48:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:48:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:48:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:48:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:48:04 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-10-25 17:48:14 [DEBUG   ] Got command RPT from MCS: ref #269484
2018-10-25 17:48:15 [DEBUG   ] summary = ERROR
2018-10-25 17:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269484  13 58416 64095115 A  ERRORERROR'
2018-10-25 17:48:15 [DEBUG   ] Got command RPT from MCS: ref #269485
2018-10-25 17:48:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269485  84 58416 64095149 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:48:15 [DEBUG   ] Got command RPT from MCS: ref #269486
2018-10-25 17:48:15 [DEBUG   ] summary = ERROR
2018-10-25 17:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269486  13 58416 64095353 A  ERRORERROR'
2018-10-25 17:48:15 [DEBUG   ] Got command RPT from MCS: ref #269487
2018-10-25 17:48:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269487  84 58416 64095545 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:48:15 [DEBUG   ] Got command RPT from MCS: ref #269488
2018-10-25 17:48:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269488  12 58416 64095749 A  ERRORB—™š'
2018-10-25 17:48:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 17:48:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 17:49:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 17:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 17:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:49:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:49:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:49:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:49:04 [WARNING ] (13, 1, 'bot')
2018-10-25 17:49:04 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:49:04 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-10-25 17:49:11 [DEBUG   ] Got command TBW from MCS: ref #269490
2018-10-25 17:49:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-25 17:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   269490   8 58416 64151597 A  ERROR'
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-25 17:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-25 17:49:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-25 17:49:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-25 17:49:15 [DEBUG   ] spawn_process: at 2018-10-25 17:49:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-25 17:49:15 [INFO    ] Finished spawning TBW
2018-10-25 17:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:50:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:50:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:50:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:50:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:50:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:50:05 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-10-25 17:50:37 [DEBUG   ] Got command RPT from MCS: ref #269498
2018-10-25 17:50:37 [DEBUG   ] summary = ERROR
2018-10-25 17:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269498  13 58416 64237117 A  ERRORERROR'
2018-10-25 17:50:37 [DEBUG   ] Got command RPT from MCS: ref #269499
2018-10-25 17:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269499  84 58416 64237118 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:51:03 [INFO    ] __waitForTBW - TBW finished in 108.738 s
2018-10-25 17:51:04 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-10-25 17:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:51:04 [INFO    ] Started antennas statistics background thread
2018-10-25 17:51:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540489866']
2018-10-25 17:51:04 [DEBUG   ] spawn_process: at 2018-10-25 17:51:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540489866']
2018-10-25 17:51:04 [INFO    ] Finished spawning TBN in 0.052 s
2018-10-25 17:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:51:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:51:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:51:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:51:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:51:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:51:05 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-10-25 17:51:24 [DEBUG   ] Finished updating ant stats in 0.439 seconds
2018-10-25 17:51:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 17:52:04 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2018-10-25 17:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:52:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:52:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:52:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:52:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:52:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:52:05 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-10-25 17:52:25 [DEBUG   ] Finished updating ant stats in 1.351 seconds
2018-10-25 17:52:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 17:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:53:05 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-10-25 17:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:53:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:53:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:53:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:53:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:53:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:53:05 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-10-25 17:53:15 [DEBUG   ] Got command RPT from MCS: ref #269525
2018-10-25 17:53:15 [DEBUG   ] summary = ERROR
2018-10-25 17:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269525  13 58416 64395033 A  ERRORERROR'
2018-10-25 17:53:15 [DEBUG   ] Got command RPT from MCS: ref #269526
2018-10-25 17:53:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269526  84 58416 64395237 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:53:15 [DEBUG   ] Got command RPT from MCS: ref #269527
2018-10-25 17:53:15 [DEBUG   ] summary = ERROR
2018-10-25 17:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269527  13 58416 64395441 A  ERRORERROR'
2018-10-25 17:53:15 [DEBUG   ] Got command RPT from MCS: ref #269529
2018-10-25 17:53:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269529  84 58416 64395633 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:53:15 [DEBUG   ] Got command RPT from MCS: ref #269530
2018-10-25 17:53:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269530  12 58416 64395837 A  ERRORB–™š'
2018-10-25 17:53:25 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-25 17:53:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 17:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:54:05 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-10-25 17:54:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:54:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:54:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:54:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:54:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:54:05 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-25 17:54:25 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-10-25 17:54:46 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2018-10-25 17:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:55:05 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-10-25 17:55:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:55:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:55:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:55:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:55:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:55:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:55:05 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-25 17:55:26 [DEBUG   ] Finished updating ant stats in 1.361 seconds
2018-10-25 17:55:37 [DEBUG   ] Got command RPT from MCS: ref #269539
2018-10-25 17:55:37 [DEBUG   ] summary = ERROR
2018-10-25 17:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269539  13 58416 64537121 A  ERRORERROR'
2018-10-25 17:55:37 [DEBUG   ] Got command RPT from MCS: ref #269540
2018-10-25 17:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269540  84 58416 64537122 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:55:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 17:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:56:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:56:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:56:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:56:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:56:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:56:05 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-10-25 17:56:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 17:56:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 17:56:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 17:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:57:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:57:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:57:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:57:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:57:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:57:05 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-25 17:57:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 17:57:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 17:57:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 17:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:58:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:58:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:58:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:58:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:58:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:58:05 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-25 17:58:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 17:58:15 [DEBUG   ] Got command RPT from MCS: ref #269556
2018-10-25 17:58:15 [DEBUG   ] summary = ERROR
2018-10-25 17:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269556  13 58416 64695121 A  ERRORERROR'
2018-10-25 17:58:15 [DEBUG   ] Got command RPT from MCS: ref #269557
2018-10-25 17:58:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269557  84 58416 64695325 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:58:15 [DEBUG   ] Got command RPT from MCS: ref #269558
2018-10-25 17:58:15 [DEBUG   ] summary = ERROR
2018-10-25 17:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269558  13 58416 64695517 A  ERRORERROR'
2018-10-25 17:58:15 [DEBUG   ] Got command RPT from MCS: ref #269559
2018-10-25 17:58:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 17:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269559  84 58416 64695721 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 17:58:15 [DEBUG   ] Got command RPT from MCS: ref #269560
2018-10-25 17:58:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 17:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269560  12 58416 64695925 A  ERRORB•™š'
2018-10-25 17:58:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 17:58:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 17:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 17:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 17:59:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:59:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:59:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:59:05 [WARNING ] (13, 1, 'bot')
2018-10-25 17:59:05 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 17:59:05 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-25 17:59:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:59:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 17:59:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 18:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:00:06 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-10-25 18:00:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:00:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:00:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:00:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:00:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:00:06 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-10-25 18:00:27 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-10-25 18:00:37 [DEBUG   ] Got command RPT from MCS: ref #269565
2018-10-25 18:00:37 [DEBUG   ] summary = ERROR
2018-10-25 18:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269565  13 58416 64837121 A  ERRORERROR'
2018-10-25 18:00:37 [DEBUG   ] Got command RPT from MCS: ref #269566
2018-10-25 18:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269566  84 58416 64837122 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:00:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 18:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:01:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:01:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:01:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:01:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:01:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:01:06 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-10-25 18:01:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 18:01:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 18:01:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:02:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 18:02:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:02:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:02:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:02:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:02:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:02:06 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-10-25 18:02:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:02:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:02:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:03:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:03:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:03:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:03:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:03:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:03:06 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-25 18:03:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:03:15 [DEBUG   ] Got command RPT from MCS: ref #269588
2018-10-25 18:03:15 [DEBUG   ] summary = ERROR
2018-10-25 18:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269588  13 58416 64995209 A  ERRORERROR'
2018-10-25 18:03:15 [DEBUG   ] Got command RPT from MCS: ref #269589
2018-10-25 18:03:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269589  84 58416 64995401 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:03:15 [DEBUG   ] Got command RPT from MCS: ref #269590
2018-10-25 18:03:15 [DEBUG   ] summary = ERROR
2018-10-25 18:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269590  13 58416 64995605 A  ERRORERROR'
2018-10-25 18:03:15 [DEBUG   ] Got command RPT from MCS: ref #269592
2018-10-25 18:03:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269592  84 58416 64995809 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:03:16 [DEBUG   ] Got command RPT from MCS: ref #269593
2018-10-25 18:03:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269593  12 58416 64996001 A  ERRORB•™š'
2018-10-25 18:03:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 18:03:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 18:04:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:04:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:04:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:04:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:04:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:04:06 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-25 18:04:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:04:27 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-25 18:04:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:05:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:05:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:05:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:05:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:05:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:05:06 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-25 18:05:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:05:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:05:37 [DEBUG   ] Got command RPT from MCS: ref #269602
2018-10-25 18:05:37 [DEBUG   ] summary = ERROR
2018-10-25 18:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269602  13 58416 65137129 A  ERRORERROR'
2018-10-25 18:05:37 [DEBUG   ] Got command RPT from MCS: ref #269603
2018-10-25 18:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269603  84 58416 65137130 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:05:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 18:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:06:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:06:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:06:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:06:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:06:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:06:06 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-25 18:06:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 18:06:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-25 18:06:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 18:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:07:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:07:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:07:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:07:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:07:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:07:06 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-25 18:07:07 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2018-10-25 18:07:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 18:07:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 18:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:08:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:08:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:08:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:08:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:08:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:08:06 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-25 18:08:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:08:15 [DEBUG   ] Got command RPT from MCS: ref #269623
2018-10-25 18:08:15 [DEBUG   ] summary = ERROR
2018-10-25 18:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269623  13 58416 65295293 A  ERRORERROR'
2018-10-25 18:08:15 [DEBUG   ] Got command RPT from MCS: ref #269624
2018-10-25 18:08:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269624  84 58416 65295485 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:08:15 [DEBUG   ] Got command RPT from MCS: ref #269625
2018-10-25 18:08:15 [DEBUG   ] summary = ERROR
2018-10-25 18:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269625  13 58416 65295689 A  ERRORERROR'
2018-10-25 18:08:15 [DEBUG   ] Got command RPT from MCS: ref #269626
2018-10-25 18:08:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269626  84 58416 65295893 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:08:16 [DEBUG   ] Got command RPT from MCS: ref #269627
2018-10-25 18:08:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269627  12 58416 65296097 A  ERRORB•™š'
2018-10-25 18:08:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:08:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 18:09:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:09:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:09:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:09:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:09:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:09:06 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-25 18:09:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 18:09:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 18:09:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 18:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:10:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:10:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:10:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:10:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:10:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:10:06 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-25 18:10:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 18:10:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 18:10:37 [DEBUG   ] Got command RPT from MCS: ref #269632
2018-10-25 18:10:37 [DEBUG   ] summary = ERROR
2018-10-25 18:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269632  13 58416 65437129 A  ERRORERROR'
2018-10-25 18:10:37 [DEBUG   ] Got command RPT from MCS: ref #269633
2018-10-25 18:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269633  84 58416 65437130 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:10:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 18:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 18:11:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:11:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:11:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:11:06 [WARNING ] (13, 1, 'bot')
2018-10-25 18:11:06 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:11:06 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-10-25 18:11:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:11:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:11:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:12:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:12:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:12:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:12:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:12:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:12:07 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-25 18:12:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 18:12:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 18:12:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 18:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:13:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:13:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:13:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:13:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:13:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:13:07 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-25 18:13:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:13:15 [DEBUG   ] Got command RPT from MCS: ref #269651
2018-10-25 18:13:15 [DEBUG   ] summary = ERROR
2018-10-25 18:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269651  13 58416 65595373 A  ERRORERROR'
2018-10-25 18:13:15 [DEBUG   ] Got command RPT from MCS: ref #269652
2018-10-25 18:13:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269652  84 58416 65595577 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:13:15 [DEBUG   ] Got command RPT from MCS: ref #269653
2018-10-25 18:13:15 [DEBUG   ] summary = ERROR
2018-10-25 18:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269653  13 58416 65595781 A  ERRORERROR'
2018-10-25 18:13:15 [DEBUG   ] Got command RPT from MCS: ref #269655
2018-10-25 18:13:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269655  84 58416 65595973 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:13:16 [DEBUG   ] Got command RPT from MCS: ref #269656
2018-10-25 18:13:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269656  12 58416 65596177 A  ERRORB”™š'
2018-10-25 18:13:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:13:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:14:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:14:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:14:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:14:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:14:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:14:07 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 18:14:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 18:14:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 18:14:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:15:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:15:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:15:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:15:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:15:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:15:07 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-10-25 18:15:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 18:15:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:15:37 [DEBUG   ] Got command RPT from MCS: ref #269665
2018-10-25 18:15:37 [DEBUG   ] summary = ERROR
2018-10-25 18:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269665  13 58416 65737125 A  ERRORERROR'
2018-10-25 18:15:37 [DEBUG   ] Got command RPT from MCS: ref #269666
2018-10-25 18:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269666  84 58416 65737126 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:15:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 18:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:16:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:16:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:16:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:16:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:16:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:16:07 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-25 18:16:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:16:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:16:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 18:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:17:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:17:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:17:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:17:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:17:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:17:07 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-25 18:17:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 18:17:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 18:17:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 18:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:18:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:18:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:18:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:18:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:18:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:18:07 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-25 18:18:10 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-25 18:18:15 [DEBUG   ] Got command RPT from MCS: ref #269686
2018-10-25 18:18:15 [DEBUG   ] summary = ERROR
2018-10-25 18:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269686  13 58416 65895461 A  ERRORERROR'
2018-10-25 18:18:15 [DEBUG   ] Got command RPT from MCS: ref #269687
2018-10-25 18:18:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269687  84 58416 65895665 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:18:15 [DEBUG   ] Got command RPT from MCS: ref #269688
2018-10-25 18:18:15 [DEBUG   ] summary = ERROR
2018-10-25 18:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269688  13 58416 65895857 A  ERRORERROR'
2018-10-25 18:18:16 [DEBUG   ] Got command RPT from MCS: ref #269689
2018-10-25 18:18:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269689  84 58416 65896061 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:18:16 [DEBUG   ] Got command RPT from MCS: ref #269690
2018-10-25 18:18:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269690  12 58416 65896265 A  ERRORB”™š'
2018-10-25 18:18:30 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-25 18:18:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 18:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:19:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:19:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:19:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:19:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:19:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:19:07 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-25 18:19:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 18:19:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 18:19:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:20:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:20:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:20:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:20:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:20:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:20:07 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-25 18:20:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:20:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:20:37 [DEBUG   ] Got command RPT from MCS: ref #269695
2018-10-25 18:20:37 [DEBUG   ] summary = ERROR
2018-10-25 18:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269695  13 58416 66037125 A  ERRORERROR'
2018-10-25 18:20:37 [DEBUG   ] Got command RPT from MCS: ref #269696
2018-10-25 18:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269696  84 58416 66037126 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:20:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 18:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 18:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:21:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:21:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:21:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:21:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:21:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:21:07 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-25 18:21:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 18:21:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:21:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 18:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-25 18:22:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:22:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:22:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:22:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:22:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:22:07 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-25 18:22:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 18:22:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:22:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:23:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:23:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:23:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:23:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:23:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:23:07 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-25 18:23:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 18:23:15 [DEBUG   ] Got command RPT from MCS: ref #269718
2018-10-25 18:23:15 [DEBUG   ] summary = ERROR
2018-10-25 18:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269718  13 58416 66195545 A  ERRORERROR'
2018-10-25 18:23:15 [DEBUG   ] Got command RPT from MCS: ref #269719
2018-10-25 18:23:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269719  84 58416 66195749 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:23:15 [DEBUG   ] Got command RPT from MCS: ref #269720
2018-10-25 18:23:15 [DEBUG   ] summary = ERROR
2018-10-25 18:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269720  13 58416 66195941 A  ERRORERROR'
2018-10-25 18:23:16 [DEBUG   ] Got command RPT from MCS: ref #269722
2018-10-25 18:23:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269722  84 58416 66196145 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:23:16 [DEBUG   ] Got command RPT from MCS: ref #269724
2018-10-25 18:23:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269724  12 58416 66196349 A  ERRORB—™š'
2018-10-25 18:23:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 18:23:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-25 18:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:24:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:24:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:24:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:24:07 [WARNING ] (13, 1, 'bot')
2018-10-25 18:24:07 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:24:07 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-25 18:24:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 18:24:30 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-25 18:24:50 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-25 18:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:25:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:25:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:25:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:25:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:25:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:25:08 [DEBUG   ] Finished updating board flags in 2.097 seconds
2018-10-25 18:25:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 18:25:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:25:37 [DEBUG   ] Got command RPT from MCS: ref #269732
2018-10-25 18:25:37 [DEBUG   ] summary = ERROR
2018-10-25 18:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269732  13 58416 66337137 A  ERRORERROR'
2018-10-25 18:25:37 [DEBUG   ] Got command RPT from MCS: ref #269733
2018-10-25 18:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269733  84 58416 66337138 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:25:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:26:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:26:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:26:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:26:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:26:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:26:08 [DEBUG   ] Finished updating board flags in 1.918 seconds
2018-10-25 18:26:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:26:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:26:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 18:27:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 18:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:27:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:27:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:27:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:27:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:27:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:27:08 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-25 18:27:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 18:27:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:27:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 18:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:28:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:28:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:28:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:28:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:28:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:28:08 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-25 18:28:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 18:28:15 [DEBUG   ] Got command RPT from MCS: ref #269749
2018-10-25 18:28:15 [DEBUG   ] summary = ERROR
2018-10-25 18:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269749  13 58416 66495625 A  ERRORERROR'
2018-10-25 18:28:15 [DEBUG   ] Got command RPT from MCS: ref #269750
2018-10-25 18:28:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269750  84 58416 66495829 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:28:16 [DEBUG   ] Got command RPT from MCS: ref #269751
2018-10-25 18:28:16 [DEBUG   ] summary = ERROR
2018-10-25 18:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269751  13 58416 66496033 A  ERRORERROR'
2018-10-25 18:28:16 [DEBUG   ] Got command RPT from MCS: ref #269752
2018-10-25 18:28:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269752  84 58416 66496237 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:28:16 [DEBUG   ] Got command RPT from MCS: ref #269753
2018-10-25 18:28:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269753  12 58416 66496429 A  ERRORB—™š'
2018-10-25 18:28:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 18:28:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 18:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:29:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:29:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:29:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:29:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:29:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:29:08 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-25 18:29:12 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 18:29:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 18:29:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 18:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:30:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:30:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:30:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:30:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:30:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:30:08 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-25 18:30:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 18:30:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:30:37 [DEBUG   ] Got command RPT from MCS: ref #269758
2018-10-25 18:30:37 [DEBUG   ] summary = ERROR
2018-10-25 18:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269758  13 58416 66637137 A  ERRORERROR'
2018-10-25 18:30:37 [DEBUG   ] Got command RPT from MCS: ref #269759
2018-10-25 18:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269759  84 58416 66637138 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:30:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:31:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:31:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:31:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:31:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:31:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:31:08 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-25 18:31:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:31:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:31:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 18:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:32:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:32:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:32:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:32:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:32:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:32:08 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-25 18:32:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:32:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 18:32:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 18:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:33:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:33:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:33:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:33:08 [WARNING ] (13, 1, 'bot')
2018-10-25 18:33:08 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:33:08 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-25 18:33:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 18:33:15 [DEBUG   ] Got command RPT from MCS: ref #269781
2018-10-25 18:33:15 [DEBUG   ] summary = ERROR
2018-10-25 18:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269781  13 58416 66795717 A  ERRORERROR'
2018-10-25 18:33:15 [DEBUG   ] Got command RPT from MCS: ref #269782
2018-10-25 18:33:15 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269782  84 58416 66795909 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:33:16 [DEBUG   ] Got command RPT from MCS: ref #269783
2018-10-25 18:33:16 [DEBUG   ] summary = ERROR
2018-10-25 18:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269783  13 58416 66796113 A  ERRORERROR'
2018-10-25 18:33:16 [DEBUG   ] Got command RPT from MCS: ref #269785
2018-10-25 18:33:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269785  84 58416 66796330 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:33:16 [DEBUG   ] Got command RPT from MCS: ref #269786
2018-10-25 18:33:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269786  12 58416 66796521 A  ERRORB—™š'
2018-10-25 18:33:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:33:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 18:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:34:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:34:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:34:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:34:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:34:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:34:09 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-25 18:34:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:34:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 18:34:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 18:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:35:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:35:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:35:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:35:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:35:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:35:09 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-25 18:35:13 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2018-10-25 18:35:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 18:35:37 [DEBUG   ] Got command RPT from MCS: ref #269795
2018-10-25 18:35:37 [DEBUG   ] summary = ERROR
2018-10-25 18:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269795  13 58416 66937133 A  ERRORERROR'
2018-10-25 18:35:37 [DEBUG   ] Got command RPT from MCS: ref #269796
2018-10-25 18:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269796  84 58416 66937134 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:35:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 18:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:36:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:36:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:36:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:36:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:36:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:36:09 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-25 18:36:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 18:36:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 18:36:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 18:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:37:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:37:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:37:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:37:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:37:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:37:09 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-25 18:37:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:37:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:37:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:38:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:38:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:38:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:38:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:38:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:38:09 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-25 18:38:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:38:15 [DEBUG   ] Got command RPT from MCS: ref #269816
2018-10-25 18:38:15 [DEBUG   ] summary = ERROR
2018-10-25 18:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269816  13 58416 67095797 A  ERRORERROR'
2018-10-25 18:38:16 [DEBUG   ] Got command RPT from MCS: ref #269817
2018-10-25 18:38:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269817  84 58416 67096001 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:38:16 [DEBUG   ] Got command RPT from MCS: ref #269818
2018-10-25 18:38:16 [DEBUG   ] summary = ERROR
2018-10-25 18:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269818  13 58416 67096205 A  ERRORERROR'
2018-10-25 18:38:16 [DEBUG   ] Got command RPT from MCS: ref #269819
2018-10-25 18:38:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269819  84 58416 67096409 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:38:16 [DEBUG   ] Got command RPT from MCS: ref #269820
2018-10-25 18:38:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269820  12 58416 67096601 A  ERRORB–™š'
2018-10-25 18:38:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:38:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:39:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:39:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:39:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:39:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:39:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:39:09 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-10-25 18:39:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:39:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 18:39:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:40:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:40:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:40:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:40:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:40:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:40:09 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-25 18:40:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 18:40:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 18:40:37 [DEBUG   ] Got command RPT from MCS: ref #269825
2018-10-25 18:40:37 [DEBUG   ] summary = ERROR
2018-10-25 18:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269825  13 58416 67237129 A  ERRORERROR'
2018-10-25 18:40:37 [DEBUG   ] Got command RPT from MCS: ref #269826
2018-10-25 18:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269826  84 58416 67237130 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:40:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 18:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:41:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:41:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:41:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:41:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:41:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:41:09 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-25 18:41:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 18:41:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 18:41:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 18:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 18:42:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:42:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:42:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:42:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:42:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:42:09 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-25 18:42:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:42:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:42:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:43:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 18:43:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:43:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:43:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:43:09 [WARNING ] (13, 1, 'bot')
2018-10-25 18:43:09 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:43:09 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-25 18:43:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 18:43:15 [DEBUG   ] Got command RPT from MCS: ref #269844
2018-10-25 18:43:15 [DEBUG   ] summary = ERROR
2018-10-25 18:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269844  13 58416 67395885 A  ERRORERROR'
2018-10-25 18:43:16 [DEBUG   ] Got command RPT from MCS: ref #269845
2018-10-25 18:43:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269845  84 58416 67396089 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:43:16 [DEBUG   ] Got command RPT from MCS: ref #269846
2018-10-25 18:43:16 [DEBUG   ] summary = ERROR
2018-10-25 18:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269846  13 58416 67396293 A  ERRORERROR'
2018-10-25 18:43:16 [DEBUG   ] Got command RPT from MCS: ref #269848
2018-10-25 18:43:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269848  84 58416 67396485 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:43:16 [DEBUG   ] Got command RPT from MCS: ref #269849
2018-10-25 18:43:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269849  12 58416 67396689 A  ERRORB–™š'
2018-10-25 18:43:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:43:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:44:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:44:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:44:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:44:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:44:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:44:10 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-10-25 18:44:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 18:44:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 18:44:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:45:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:45:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:45:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:45:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:45:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:45:10 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-25 18:45:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:45:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 18:45:37 [DEBUG   ] Got command RPT from MCS: ref #269858
2018-10-25 18:45:37 [DEBUG   ] summary = ERROR
2018-10-25 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269858  13 58416 67537137 A  ERRORERROR'
2018-10-25 18:45:37 [DEBUG   ] Got command RPT from MCS: ref #269859
2018-10-25 18:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269859  84 58416 67537138 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:45:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 18:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:46:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:46:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:46:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:46:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:46:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:46:10 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-25 18:46:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 18:46:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 18:46:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-25 18:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:47:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:47:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:47:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:47:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:47:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:47:10 [DEBUG   ] Finished updating board flags in 1.945 seconds
2018-10-25 18:47:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 18:47:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 18:47:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:48:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:48:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:48:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:48:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:48:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:48:10 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 18:48:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:48:15 [DEBUG   ] Got command RPT from MCS: ref #269879
2018-10-25 18:48:15 [DEBUG   ] summary = ERROR
2018-10-25 18:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269879  13 58416 67695969 A  ERRORERROR'
2018-10-25 18:48:16 [DEBUG   ] Got command RPT from MCS: ref #269880
2018-10-25 18:48:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269880  84 58416 67696173 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:48:16 [DEBUG   ] Got command RPT from MCS: ref #269881
2018-10-25 18:48:16 [DEBUG   ] summary = ERROR
2018-10-25 18:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269881  13 58416 67696377 A  ERRORERROR'
2018-10-25 18:48:16 [DEBUG   ] Got command RPT from MCS: ref #269882
2018-10-25 18:48:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269882  84 58416 67696581 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:48:16 [DEBUG   ] Got command RPT from MCS: ref #269883
2018-10-25 18:48:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269883  12 58416 67696773 A  ERRORB•™š'
2018-10-25 18:48:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:48:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 18:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:49:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:49:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:49:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:49:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:49:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:49:10 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-25 18:49:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 18:49:35 [DEBUG   ] Finished updating ant stats in 0.782 seconds
2018-10-25 18:49:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:50:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:50:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:50:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:50:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:50:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:50:10 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-25 18:50:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:50:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 18:50:37 [DEBUG   ] Got command RPT from MCS: ref #269888
2018-10-25 18:50:37 [DEBUG   ] summary = ERROR
2018-10-25 18:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269888  13 58416 67837133 A  ERRORERROR'
2018-10-25 18:50:37 [DEBUG   ] Got command RPT from MCS: ref #269889
2018-10-25 18:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269889  84 58416 67837134 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:50:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 18:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:51:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:51:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:51:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:51:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:51:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:51:10 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-25 18:51:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 18:51:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:51:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:52:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:52:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:52:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:52:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:52:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:52:10 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-25 18:52:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:52:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:52:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 18:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:53:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:53:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:53:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:53:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:53:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:53:10 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-25 18:53:16 [DEBUG   ] Got command RPT from MCS: ref #269911
2018-10-25 18:53:16 [DEBUG   ] summary = ERROR
2018-10-25 18:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269911  13 58416 67996053 A  ERRORERROR'
2018-10-25 18:53:16 [DEBUG   ] Got command RPT from MCS: ref #269912
2018-10-25 18:53:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269912  84 58416 67996257 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:53:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:53:16 [DEBUG   ] Got command RPT from MCS: ref #269913
2018-10-25 18:53:16 [DEBUG   ] summary = ERROR
2018-10-25 18:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269913  13 58416 67996461 A  ERRORERROR'
2018-10-25 18:53:16 [DEBUG   ] Got command RPT from MCS: ref #269915
2018-10-25 18:53:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269915  84 58416 67996653 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:53:16 [DEBUG   ] Got command RPT from MCS: ref #269917
2018-10-25 18:53:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269917  12 58416 67996857 A  ERRORB•™š'
2018-10-25 18:53:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 18:53:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 18:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:54:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:54:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:54:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:54:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:54:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:54:10 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-25 18:54:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:54:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 18:54:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 18:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:55:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:55:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:55:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:55:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:55:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:55:11 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-10-25 18:55:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 18:55:37 [DEBUG   ] Got command RPT from MCS: ref #269925
2018-10-25 18:55:37 [DEBUG   ] summary = ERROR
2018-10-25 18:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269925  13 58416 68137141 A  ERRORERROR'
2018-10-25 18:55:37 [DEBUG   ] Got command RPT from MCS: ref #269926
2018-10-25 18:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269926  84 58416 68137142 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:55:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-25 18:55:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 18:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:56:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:56:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:56:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:56:10 [WARNING ] (13, 1, 'bot')
2018-10-25 18:56:10 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:56:10 [DEBUG   ] Finished updating board flags in 1.314 seconds
2018-10-25 18:56:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 18:56:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 18:56:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 18:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:57:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:57:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:57:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:57:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:57:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:57:11 [DEBUG   ] Finished updating board flags in 2.097 seconds
2018-10-25 18:57:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 18:57:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 18:57:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 18:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:58:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:58:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:58:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:58:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:58:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:58:11 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-25 18:58:16 [DEBUG   ] Got command RPT from MCS: ref #269942
2018-10-25 18:58:16 [DEBUG   ] summary = ERROR
2018-10-25 18:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269942  13 58416 68296149 A  ERRORERROR'
2018-10-25 18:58:16 [DEBUG   ] Got command RPT from MCS: ref #269943
2018-10-25 18:58:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269943  84 58416 68296341 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:58:16 [DEBUG   ] Got command RPT from MCS: ref #269944
2018-10-25 18:58:16 [DEBUG   ] summary = ERROR
2018-10-25 18:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269944  13 58416 68296546 A  ERRORERROR'
2018-10-25 18:58:16 [DEBUG   ] Got command RPT from MCS: ref #269945
2018-10-25 18:58:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 18:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269945  84 58416 68296749 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 18:58:16 [DEBUG   ] Got command RPT from MCS: ref #269946
2018-10-25 18:58:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 18:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269946  12 58416 68296941 A  ERRORB•™š'
2018-10-25 18:58:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:58:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 18:58:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 18:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 18:59:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:59:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:59:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:59:11 [WARNING ] (13, 1, 'bot')
2018-10-25 18:59:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 18:59:11 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-25 18:59:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 18:59:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 18:59:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:00:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:00:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:00:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:00:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:00:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:00:11 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-25 19:00:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 19:00:37 [DEBUG   ] Got command RPT from MCS: ref #269951
2018-10-25 19:00:37 [DEBUG   ] summary = ERROR
2018-10-25 19:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269951  13 58416 68437141 A  ERRORERROR'
2018-10-25 19:00:37 [DEBUG   ] Got command RPT from MCS: ref #269952
2018-10-25 19:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269952  84 58416 68437142 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:00:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 19:00:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 19:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:01:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:01:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:01:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:01:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:01:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:01:11 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-25 19:01:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 19:01:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 19:01:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 19:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-10-25 19:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:02:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:02:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:02:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:02:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:02:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:02:11 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-25 19:02:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 19:02:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 19:02:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 19:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:03:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:03:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:03:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:03:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:03:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:03:11 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-25 19:03:16 [DEBUG   ] Got command RPT from MCS: ref #269974
2018-10-25 19:03:16 [DEBUG   ] summary = ERROR
2018-10-25 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269974  13 58416 68596233 A  ERRORERROR'
2018-10-25 19:03:16 [DEBUG   ] Got command RPT from MCS: ref #269975
2018-10-25 19:03:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269975  84 58416 68596426 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:03:16 [DEBUG   ] Got command RPT from MCS: ref #269976
2018-10-25 19:03:16 [DEBUG   ] summary = ERROR
2018-10-25 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269976  13 58416 68596629 A  ERRORERROR'
2018-10-25 19:03:16 [DEBUG   ] Got command RPT from MCS: ref #269978
2018-10-25 19:03:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269978  84 58416 68596833 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:03:17 [DEBUG   ] Got command RPT from MCS: ref #269980
2018-10-25 19:03:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269980  12 58416 68597037 A  ERRORB•™š'
2018-10-25 19:03:18 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2018-10-25 19:03:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:03:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 19:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:04:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:04:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:04:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:04:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:04:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:04:11 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-25 19:04:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 19:04:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:04:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 19:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:05:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:05:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:05:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:05:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:05:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:05:11 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-25 19:05:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 19:05:37 [DEBUG   ] Got command RPT from MCS: ref #269988
2018-10-25 19:05:37 [DEBUG   ] summary = ERROR
2018-10-25 19:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269988  13 58416 68737137 A  ERRORERROR'
2018-10-25 19:05:37 [DEBUG   ] Got command RPT from MCS: ref #269989
2018-10-25 19:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   269989  84 58416 68737138 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:05:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 19:05:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 19:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:06:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:06:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:06:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:06:11 [WARNING ] (13, 1, 'bot')
2018-10-25 19:06:11 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:06:11 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-10-25 19:06:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 19:06:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 19:06:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 19:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:07:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:07:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:07:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:07:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:07:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:07:12 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-25 19:07:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 19:07:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 19:07:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:08:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:08:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:08:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:08:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:08:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:08:12 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-25 19:08:16 [DEBUG   ] Got command RPT from MCS: ref #270009
2018-10-25 19:08:16 [DEBUG   ] summary = ERROR
2018-10-25 19:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270009  13 58416 68896313 A  ERRORERROR'
2018-10-25 19:08:16 [DEBUG   ] Got command RPT from MCS: ref #270010
2018-10-25 19:08:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270010  84 58416 68896517 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:08:16 [DEBUG   ] Got command RPT from MCS: ref #270011
2018-10-25 19:08:16 [DEBUG   ] summary = ERROR
2018-10-25 19:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270011  13 58416 68896709 A  ERRORERROR'
2018-10-25 19:08:16 [DEBUG   ] Got command RPT from MCS: ref #270012
2018-10-25 19:08:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270012  84 58416 68896913 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:08:17 [DEBUG   ] Got command RPT from MCS: ref #270013
2018-10-25 19:08:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270013  12 58416 68897117 A  ERRORB•™š'
2018-10-25 19:08:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:08:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:08:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 19:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:09:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:09:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:09:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:09:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:09:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:09:12 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-25 19:09:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 19:09:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:09:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 19:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 19:10:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:10:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:10:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:10:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:10:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:10:12 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-25 19:10:19 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-25 19:10:37 [DEBUG   ] Got command RPT from MCS: ref #270018
2018-10-25 19:10:37 [DEBUG   ] summary = ERROR
2018-10-25 19:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270018  13 58416 69037145 A  ERRORERROR'
2018-10-25 19:10:37 [DEBUG   ] Got command RPT from MCS: ref #270019
2018-10-25 19:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270019  84 58416 69037146 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:10:39 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-25 19:11:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 19:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:11:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:11:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:11:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:11:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:11:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:11:12 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-10-25 19:11:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 19:11:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:12:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:12:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:12:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:12:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:12:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:12:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:12:12 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-25 19:12:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:12:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 19:13:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 19:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:13:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:13:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:13:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:13:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:13:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:13:12 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-25 19:13:16 [DEBUG   ] Got command RPT from MCS: ref #270037
2018-10-25 19:13:16 [DEBUG   ] summary = ERROR
2018-10-25 19:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270037  13 58416 69196401 A  ERRORERROR'
2018-10-25 19:13:16 [DEBUG   ] Got command RPT from MCS: ref #270038
2018-10-25 19:13:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270038  84 58416 69196605 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:13:16 [DEBUG   ] Got command RPT from MCS: ref #270039
2018-10-25 19:13:16 [DEBUG   ] summary = ERROR
2018-10-25 19:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270039  13 58416 69196797 A  ERRORERROR'
2018-10-25 19:13:17 [DEBUG   ] Got command RPT from MCS: ref #270041
2018-10-25 19:13:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270041  84 58416 69197001 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:13:17 [DEBUG   ] Got command RPT from MCS: ref #270042
2018-10-25 19:13:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270042  12 58416 69197205 A  ERRORB”™š'
2018-10-25 19:13:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:13:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:14:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 19:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:14:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:14:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:14:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:14:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:14:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:14:12 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-25 19:14:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:14:41 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2018-10-25 19:15:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-25 19:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:15:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:15:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:15:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:15:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:15:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:15:12 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-25 19:15:21 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 19:15:37 [DEBUG   ] Got command RPT from MCS: ref #270051
2018-10-25 19:15:37 [DEBUG   ] summary = ERROR
2018-10-25 19:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270051  13 58416 69337145 A  ERRORERROR'
2018-10-25 19:15:37 [DEBUG   ] Got command RPT from MCS: ref #270052
2018-10-25 19:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270052  84 58416 69337146 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:15:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 19:16:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 19:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:16:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:16:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:16:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:16:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:16:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:16:12 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-10-25 19:16:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 19:16:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 19:17:01 [DEBUG   ] Finished updating ant stats in 1.077 seconds
2018-10-25 19:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 19:17:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:17:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:17:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:17:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:17:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:17:12 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-25 19:17:21 [DEBUG   ] Finished updating ant stats in 0.929 seconds
2018-10-25 19:17:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 19:18:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:18:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:18:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:18:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:18:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:18:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:18:12 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-25 19:18:16 [DEBUG   ] Got command RPT from MCS: ref #270072
2018-10-25 19:18:16 [DEBUG   ] summary = ERROR
2018-10-25 19:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270072  13 58416 69496481 A  ERRORERROR'
2018-10-25 19:18:16 [DEBUG   ] Got command RPT from MCS: ref #270073
2018-10-25 19:18:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270073  84 58416 69496685 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:18:16 [DEBUG   ] Got command RPT from MCS: ref #270074
2018-10-25 19:18:16 [DEBUG   ] summary = ERROR
2018-10-25 19:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270074  13 58416 69496889 A  ERRORERROR'
2018-10-25 19:18:17 [DEBUG   ] Got command RPT from MCS: ref #270075
2018-10-25 19:18:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270075  84 58416 69497081 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:18:17 [DEBUG   ] Got command RPT from MCS: ref #270076
2018-10-25 19:18:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270076  12 58416 69497285 A  ERRORB•™š'
2018-10-25 19:18:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:18:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:19:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 19:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:19:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:19:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:19:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:19:12 [WARNING ] (13, 1, 'bot')
2018-10-25 19:19:12 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:19:12 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-25 19:19:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 19:19:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 19:20:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 19:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:20:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:20:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:20:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:20:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:20:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:20:13 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-25 19:20:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:20:37 [DEBUG   ] Got command RPT from MCS: ref #270081
2018-10-25 19:20:37 [DEBUG   ] summary = ERROR
2018-10-25 19:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270081  13 58416 69637141 A  ERRORERROR'
2018-10-25 19:20:37 [DEBUG   ] Got command RPT from MCS: ref #270082
2018-10-25 19:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270082  84 58416 69637142 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:20:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:21:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 19:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:21:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:21:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:21:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:21:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:21:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:21:13 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-25 19:21:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 19:21:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:22:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 19:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:22:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:22:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:22:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:22:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:22:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:22:13 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-25 19:22:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 19:22:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 19:23:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:23:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 19:23:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-25 19:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:23:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 19:23:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:23:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:23:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:23:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:23:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:23:13 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-25 19:23:16 [DEBUG   ] Got command RPT from MCS: ref #270104
2018-10-25 19:23:16 [DEBUG   ] summary = ERROR
2018-10-25 19:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270104  13 58416 69796565 A  ERRORERROR'
2018-10-25 19:23:16 [DEBUG   ] Got command RPT from MCS: ref #270105
2018-10-25 19:23:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270105  84 58416 69796769 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:23:16 [DEBUG   ] Got command RPT from MCS: ref #270106
2018-10-25 19:23:16 [DEBUG   ] summary = ERROR
2018-10-25 19:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270106  13 58416 69796973 A  ERRORERROR'
2018-10-25 19:23:17 [DEBUG   ] Got command RPT from MCS: ref #270108
2018-10-25 19:23:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270108  84 58416 69797177 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:23:17 [DEBUG   ] Got command RPT from MCS: ref #270110
2018-10-25 19:23:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270110  12 58416 69797369 A  ERRORB˜™š'
2018-10-25 19:23:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:23:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:24:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 19:24:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 19:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 19:24:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:24:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:24:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:24:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:24:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:24:13 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-25 19:24:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 19:24:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 19:25:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 19:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 19:25:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:25:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:25:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:25:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:25:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:25:13 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-25 19:25:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 19:25:37 [DEBUG   ] Got command RPT from MCS: ref #270118
2018-10-25 19:25:37 [DEBUG   ] summary = ERROR
2018-10-25 19:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270118  13 58416 69937149 A  ERRORERROR'
2018-10-25 19:25:37 [DEBUG   ] Got command RPT from MCS: ref #270119
2018-10-25 19:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270119  84 58416 69937150 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:25:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 19:26:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 19:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:26:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:26:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:26:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:26:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:26:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:26:13 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-25 19:26:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:26:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:27:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 19:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 19:27:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:27:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:27:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:27:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:27:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:27:13 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-25 19:27:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 19:27:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 19:28:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:28:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 19:28:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:28:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:28:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:28:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:28:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:28:13 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-25 19:28:16 [DEBUG   ] Got command RPT from MCS: ref #270135
2018-10-25 19:28:16 [DEBUG   ] summary = ERROR
2018-10-25 19:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270135  13 58416 70096657 A  ERRORERROR'
2018-10-25 19:28:16 [DEBUG   ] Got command RPT from MCS: ref #270136
2018-10-25 19:28:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270136  84 58416 70096861 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:28:17 [DEBUG   ] Got command RPT from MCS: ref #270137
2018-10-25 19:28:17 [DEBUG   ] summary = ERROR
2018-10-25 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270137  13 58416 70097053 A  ERRORERROR'
2018-10-25 19:28:17 [DEBUG   ] Got command RPT from MCS: ref #270138
2018-10-25 19:28:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270138  84 58416 70097257 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:28:17 [DEBUG   ] Got command RPT from MCS: ref #270139
2018-10-25 19:28:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270139  12 58416 70097461 A  ERRORB˜™š'
2018-10-25 19:28:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 19:28:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 19:29:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 19:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 19:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:29:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:29:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:29:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:29:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:29:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:29:13 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-25 19:29:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 19:29:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 19:30:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:30:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:30:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:30:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:30:13 [WARNING ] (13, 1, 'bot')
2018-10-25 19:30:13 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:30:13 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-10-25 19:30:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 19:30:37 [DEBUG   ] Got command RPT from MCS: ref #270144
2018-10-25 19:30:37 [DEBUG   ] summary = ERROR
2018-10-25 19:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270144  13 58416 70237141 A  ERRORERROR'
2018-10-25 19:30:37 [DEBUG   ] Got command RPT from MCS: ref #270145
2018-10-25 19:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270145  84 58416 70237142 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:30:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 19:31:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 19:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:31:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:31:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:31:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:31:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:31:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:31:14 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-25 19:31:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:31:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:32:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:32:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:32:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:32:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:32:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:32:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:32:14 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-25 19:32:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 19:32:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:33:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:33:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:33:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:33:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:33:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:33:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:33:14 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-25 19:33:16 [DEBUG   ] Got command RPT from MCS: ref #270167
2018-10-25 19:33:16 [DEBUG   ] summary = ERROR
2018-10-25 19:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270167  13 58416 70396741 A  ERRORERROR'
2018-10-25 19:33:16 [DEBUG   ] Got command RPT from MCS: ref #270168
2018-10-25 19:33:16 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270168  84 58416 70396945 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:33:17 [DEBUG   ] Got command RPT from MCS: ref #270169
2018-10-25 19:33:17 [DEBUG   ] summary = ERROR
2018-10-25 19:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270169  13 58416 70397149 A  ERRORERROR'
2018-10-25 19:33:17 [DEBUG   ] Got command RPT from MCS: ref #270171
2018-10-25 19:33:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270171  84 58416 70397341 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:33:17 [DEBUG   ] Got command RPT from MCS: ref #270172
2018-10-25 19:33:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270172  12 58416 70397545 A  ERRORB—™š'
2018-10-25 19:33:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 19:33:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 19:34:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 19:34:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 19:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:34:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:34:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:34:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:34:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:34:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:34:14 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-25 19:34:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 19:34:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 19:35:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:35:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:35:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:35:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:35:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:35:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:35:14 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-25 19:35:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:35:37 [DEBUG   ] Got command RPT from MCS: ref #270181
2018-10-25 19:35:37 [DEBUG   ] summary = ERROR
2018-10-25 19:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270181  13 58416 70537153 A  ERRORERROR'
2018-10-25 19:35:37 [DEBUG   ] Got command RPT from MCS: ref #270182
2018-10-25 19:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270182  84 58416 70537154 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:35:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:36:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 19:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:36:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 19:36:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:36:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:36:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:36:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:36:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:36:14 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-25 19:36:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:36:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:37:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 19:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:37:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:37:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:37:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:37:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:37:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:37:14 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-25 19:37:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 19:37:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 19:38:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 19:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:38:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:38:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:38:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:38:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:38:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:38:14 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-25 19:38:16 [DEBUG   ] Got command RPT from MCS: ref #270202
2018-10-25 19:38:16 [DEBUG   ] summary = ERROR
2018-10-25 19:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270202  13 58416 70696833 A  ERRORERROR'
2018-10-25 19:38:17 [DEBUG   ] Got command RPT from MCS: ref #270203
2018-10-25 19:38:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270203  84 58416 70697025 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:38:17 [DEBUG   ] Got command RPT from MCS: ref #270204
2018-10-25 19:38:17 [DEBUG   ] summary = ERROR
2018-10-25 19:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270204  13 58416 70697229 A  ERRORERROR'
2018-10-25 19:38:17 [DEBUG   ] Got command RPT from MCS: ref #270205
2018-10-25 19:38:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270205  84 58416 70697433 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:38:17 [DEBUG   ] Got command RPT from MCS: ref #270206
2018-10-25 19:38:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270206  12 58416 70697637 A  ERRORB–™š'
2018-10-25 19:38:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 19:38:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:39:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:39:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:39:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:39:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:39:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:39:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:39:14 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-25 19:39:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 19:39:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-25 19:40:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 19:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:40:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:40:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:40:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:40:14 [WARNING ] (13, 1, 'bot')
2018-10-25 19:40:14 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:40:14 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-10-25 19:40:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:40:37 [DEBUG   ] Got command RPT from MCS: ref #270211
2018-10-25 19:40:37 [DEBUG   ] summary = ERROR
2018-10-25 19:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270211  13 58416 70837153 A  ERRORERROR'
2018-10-25 19:40:37 [DEBUG   ] Got command RPT from MCS: ref #270212
2018-10-25 19:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270212  84 58416 70837154 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:40:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:41:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 19:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:41:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:41:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:41:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:41:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:41:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:41:15 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-25 19:41:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:41:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:42:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:42:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 19:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:42:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:42:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:42:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:42:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:42:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:42:15 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-25 19:42:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 19:42:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 19:43:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 19:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:43:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:43:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:43:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:43:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:43:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:43:15 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-25 19:43:16 [DEBUG   ] Got command RPT from MCS: ref #270230
2018-10-25 19:43:16 [DEBUG   ] summary = ERROR
2018-10-25 19:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270230  13 58416 70996913 A  ERRORERROR'
2018-10-25 19:43:17 [DEBUG   ] Got command RPT from MCS: ref #270231
2018-10-25 19:43:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270231  84 58416 70997117 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:43:17 [DEBUG   ] Got command RPT from MCS: ref #270232
2018-10-25 19:43:17 [DEBUG   ] summary = ERROR
2018-10-25 19:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270232  13 58416 70997309 A  ERRORERROR'
2018-10-25 19:43:17 [DEBUG   ] Got command RPT from MCS: ref #270234
2018-10-25 19:43:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270234  84 58416 70997513 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:43:17 [DEBUG   ] Got command RPT from MCS: ref #270235
2018-10-25 19:43:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270235  12 58416 70997717 A  ERRORB–™š'
2018-10-25 19:43:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 19:43:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 19:44:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 19:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:44:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 19:44:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:44:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:44:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:44:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:44:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:44:15 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 19:44:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 19:44:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:45:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:45:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:45:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:45:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:45:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:45:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:45:15 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-25 19:45:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:45:37 [DEBUG   ] Got command RPT from MCS: ref #270244
2018-10-25 19:45:37 [DEBUG   ] summary = ERROR
2018-10-25 19:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270244  13 58416 71137149 A  ERRORERROR'
2018-10-25 19:45:37 [DEBUG   ] Got command RPT from MCS: ref #270245
2018-10-25 19:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270245  84 58416 71137150 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:45:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 19:46:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:46:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:46:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:46:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:46:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:46:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:46:15 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-25 19:46:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:46:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:47:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 19:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:47:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:47:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:47:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:47:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:47:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:47:15 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-10-25 19:47:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:47:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:48:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 19:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:48:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:48:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:48:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:48:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:48:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:48:15 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-25 19:48:16 [DEBUG   ] Got command RPT from MCS: ref #270265
2018-10-25 19:48:16 [DEBUG   ] summary = ERROR
2018-10-25 19:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270265  13 58416 71296997 A  ERRORERROR'
2018-10-25 19:48:17 [DEBUG   ] Got command RPT from MCS: ref #270266
2018-10-25 19:48:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270266  84 58416 71297201 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:48:17 [DEBUG   ] Got command RPT from MCS: ref #270267
2018-10-25 19:48:17 [DEBUG   ] summary = ERROR
2018-10-25 19:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270267  13 58416 71297393 A  ERRORERROR'
2018-10-25 19:48:17 [DEBUG   ] Got command RPT from MCS: ref #270268
2018-10-25 19:48:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270268  84 58416 71297597 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:48:17 [DEBUG   ] Got command RPT from MCS: ref #270269
2018-10-25 19:48:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270269  12 58416 71297801 A  ERRORB•™š'
2018-10-25 19:48:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 19:48:47 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-25 19:49:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 19:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:49:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:49:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:49:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:49:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:49:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:49:15 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-10-25 19:49:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 19:49:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:50:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:50:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:50:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:50:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:50:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:50:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:50:15 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-25 19:50:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:50:37 [DEBUG   ] Got command RPT from MCS: ref #270274
2018-10-25 19:50:37 [DEBUG   ] summary = ERROR
2018-10-25 19:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270274  13 58416 71437149 A  ERRORERROR'
2018-10-25 19:50:37 [DEBUG   ] Got command RPT from MCS: ref #270275
2018-10-25 19:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270275  84 58416 71437150 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:50:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 19:51:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:51:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:51:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:51:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:51:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:51:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:51:15 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-10-25 19:51:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:51:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 19:52:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 19:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:52:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:52:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:52:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:52:15 [WARNING ] (13, 1, 'bot')
2018-10-25 19:52:15 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:52:15 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-10-25 19:52:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 19:52:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:53:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:53:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:53:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:53:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:53:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:53:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:53:16 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-10-25 19:53:17 [DEBUG   ] Got command RPT from MCS: ref #270297
2018-10-25 19:53:17 [DEBUG   ] summary = ERROR
2018-10-25 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270297  13 58416 71597081 A  ERRORERROR'
2018-10-25 19:53:17 [DEBUG   ] Got command RPT from MCS: ref #270298
2018-10-25 19:53:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270298  84 58416 71597285 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:53:17 [DEBUG   ] Got command RPT from MCS: ref #270299
2018-10-25 19:53:17 [DEBUG   ] summary = ERROR
2018-10-25 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270299  13 58416 71597489 A  ERRORERROR'
2018-10-25 19:53:17 [DEBUG   ] Got command RPT from MCS: ref #270301
2018-10-25 19:53:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270301  84 58416 71597681 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:53:17 [DEBUG   ] Got command RPT from MCS: ref #270302
2018-10-25 19:53:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270302  12 58416 71597885 A  ERRORB•™š'
2018-10-25 19:53:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:53:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 19:54:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:54:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:54:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:54:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:54:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:54:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:54:16 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-25 19:54:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 19:54:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 19:55:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 19:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:55:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:55:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:55:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:55:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:55:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:55:16 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-10-25 19:55:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 19:55:37 [DEBUG   ] Got command RPT from MCS: ref #270311
2018-10-25 19:55:37 [DEBUG   ] summary = ERROR
2018-10-25 19:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270311  13 58416 71737153 A  ERRORERROR'
2018-10-25 19:55:37 [DEBUG   ] Got command RPT from MCS: ref #270312
2018-10-25 19:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270312  84 58416 71737154 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:55:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 19:56:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 19:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 19:56:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:56:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:56:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:56:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:56:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:56:16 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-25 19:56:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 19:56:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 19:57:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 19:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:57:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:57:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:57:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:57:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:57:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:57:16 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-25 19:57:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 19:57:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 19:58:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 19:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:58:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:58:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:58:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:58:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:58:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:58:16 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-25 19:58:17 [DEBUG   ] Got command RPT from MCS: ref #270328
2018-10-25 19:58:17 [DEBUG   ] summary = ERROR
2018-10-25 19:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270328  13 58416 71897173 A  ERRORERROR'
2018-10-25 19:58:17 [DEBUG   ] Got command RPT from MCS: ref #270329
2018-10-25 19:58:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270329  84 58416 71897365 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:58:17 [DEBUG   ] Got command RPT from MCS: ref #270330
2018-10-25 19:58:17 [DEBUG   ] summary = ERROR
2018-10-25 19:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270330  13 58416 71897569 A  ERRORERROR'
2018-10-25 19:58:17 [DEBUG   ] Got command RPT from MCS: ref #270331
2018-10-25 19:58:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 19:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270331  84 58416 71897773 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 19:58:17 [DEBUG   ] Got command RPT from MCS: ref #270332
2018-10-25 19:58:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 19:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270332  12 58416 71897977 A  ERRORB•™š'
2018-10-25 19:58:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 19:58:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:59:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 19:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 19:59:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:59:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:59:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:59:16 [WARNING ] (13, 1, 'bot')
2018-10-25 19:59:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 19:59:16 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-25 19:59:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 19:59:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 20:00:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:00:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:00:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:00:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:00:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:00:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:00:16 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-25 20:00:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:00:37 [DEBUG   ] Got command RPT from MCS: ref #270337
2018-10-25 20:00:37 [DEBUG   ] summary = ERROR
2018-10-25 20:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270337  13 58416 72037157 A  ERRORERROR'
2018-10-25 20:00:37 [DEBUG   ] Got command RPT from MCS: ref #270338
2018-10-25 20:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270338  84 58416 72037158 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:00:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:01:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:01:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:01:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:01:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:01:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:01:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:01:16 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-10-25 20:01:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 20:01:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 20:02:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:02:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:02:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:02:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:02:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:02:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:02:16 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-25 20:02:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:02:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 20:03:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 20:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:03:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:03:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:03:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:03:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:03:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:03:16 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-25 20:03:17 [DEBUG   ] Got command RPT from MCS: ref #270360
2018-10-25 20:03:17 [DEBUG   ] summary = ERROR
2018-10-25 20:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270360  13 58416 72197261 A  ERRORERROR'
2018-10-25 20:03:17 [DEBUG   ] Got command RPT from MCS: ref #270361
2018-10-25 20:03:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270361  84 58416 72197453 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:03:17 [DEBUG   ] Got command RPT from MCS: ref #270362
2018-10-25 20:03:17 [DEBUG   ] summary = ERROR
2018-10-25 20:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270362  13 58416 72197657 A  ERRORERROR'
2018-10-25 20:03:17 [DEBUG   ] Got command RPT from MCS: ref #270364
2018-10-25 20:03:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270364  84 58416 72197861 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:03:18 [DEBUG   ] Got command RPT from MCS: ref #270365
2018-10-25 20:03:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270365  12 58416 72198065 A  ERRORB•™š'
2018-10-25 20:03:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 20:03:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 20:04:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:04:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:04:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:04:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:04:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:04:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:04:16 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-10-25 20:04:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 20:04:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-25 20:05:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:05:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:05:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:05:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:05:16 [WARNING ] (13, 1, 'bot')
2018-10-25 20:05:16 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:05:16 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-25 20:05:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 20:05:37 [DEBUG   ] Got command RPT from MCS: ref #270374
2018-10-25 20:05:37 [DEBUG   ] summary = ERROR
2018-10-25 20:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270374  13 58416 72337149 A  ERRORERROR'
2018-10-25 20:05:37 [DEBUG   ] Got command RPT from MCS: ref #270375
2018-10-25 20:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270375  84 58416 72337150 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:05:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 20:06:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 20:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:06:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:06:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:06:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:06:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:06:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:06:17 [DEBUG   ] Finished updating board flags in 2.226 seconds
2018-10-25 20:06:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 20:06:51 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2018-10-25 20:07:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:07:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:07:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:07:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:07:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:07:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:07:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:07:17 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-10-25 20:07:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 20:07:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 20:08:11 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-25 20:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:08:17 [DEBUG   ] Got command RPT from MCS: ref #270405
2018-10-25 20:08:17 [DEBUG   ] summary = ERROR
2018-10-25 20:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270405  13 58416 72497345 A  ERRORERROR'
2018-10-25 20:08:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:08:17 [DEBUG   ] Got command RPT from MCS: ref #270406
2018-10-25 20:08:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270406  84 58416 72497549 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:08:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:08:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:08:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:08:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:08:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:08:17 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-25 20:08:17 [DEBUG   ] Got command RPT from MCS: ref #270407
2018-10-25 20:08:17 [DEBUG   ] summary = ERROR
2018-10-25 20:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270407  13 58416 72497741 A  ERRORERROR'
2018-10-25 20:08:17 [DEBUG   ] Got command RPT from MCS: ref #270408
2018-10-25 20:08:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270408  84 58416 72497945 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:08:18 [DEBUG   ] Got command RPT from MCS: ref #270409
2018-10-25 20:08:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270409  12 58416 72498149 A  ERRORB•™š'
2018-10-25 20:08:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 20:08:51 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-10-25 20:09:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:09:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:09:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:09:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:09:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:09:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:09:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:09:17 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-25 20:09:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 20:09:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:10:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:10:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:10:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:10:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:10:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:10:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:10:17 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-25 20:10:31 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2018-10-25 20:10:37 [DEBUG   ] Got command RPT from MCS: ref #270414
2018-10-25 20:10:37 [DEBUG   ] summary = ERROR
2018-10-25 20:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270414  13 58416 72637161 A  ERRORERROR'
2018-10-25 20:10:37 [DEBUG   ] Got command RPT from MCS: ref #270415
2018-10-25 20:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270415  84 58416 72637162 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:10:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 20:11:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:11:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:11:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:11:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:11:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:11:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:11:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:11:17 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-25 20:11:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 20:11:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:12:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 20:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:12:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:12:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:12:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:12:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:12:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:12:17 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-25 20:12:31 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 20:12:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 20:13:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 20:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:13:17 [DEBUG   ] Got command RPT from MCS: ref #270433
2018-10-25 20:13:17 [DEBUG   ] summary = ERROR
2018-10-25 20:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270433  13 58416 72797425 A  ERRORERROR'
2018-10-25 20:13:17 [DEBUG   ] Got command RPT from MCS: ref #270434
2018-10-25 20:13:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270434  84 58416 72797629 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:13:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:13:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:13:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:13:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:13:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:13:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-25 20:13:17 [DEBUG   ] Got command RPT from MCS: ref #270435
2018-10-25 20:13:17 [DEBUG   ] summary = ERROR
2018-10-25 20:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270435  13 58416 72797833 A  ERRORERROR'
2018-10-25 20:13:18 [DEBUG   ] Got command RPT from MCS: ref #270437
2018-10-25 20:13:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270437  84 58416 72798025 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:13:18 [DEBUG   ] Got command RPT from MCS: ref #270438
2018-10-25 20:13:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270438  12 58416 72798229 A  ERRORB•™š'
2018-10-25 20:13:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 20:13:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:14:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:14:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:14:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:14:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:14:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:14:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:14:17 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-25 20:14:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 20:14:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 20:15:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:15:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:15:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:15:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:15:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:15:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:15:17 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-25 20:15:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:15:37 [DEBUG   ] Got command RPT from MCS: ref #270447
2018-10-25 20:15:37 [DEBUG   ] summary = ERROR
2018-10-25 20:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270447  13 58416 72937161 A  ERRORERROR'
2018-10-25 20:15:37 [DEBUG   ] Got command RPT from MCS: ref #270448
2018-10-25 20:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270448  84 58416 72937162 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:15:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 20:16:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 20:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:16:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:16:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:16:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:16:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:16:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:16:17 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-25 20:16:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 20:16:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 20:17:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:17:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:17:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:17:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:17:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:17:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:17:17 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-10-25 20:17:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:17:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 20:18:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 20:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:18:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:18:17 [DEBUG   ] Got command RPT from MCS: ref #270468
2018-10-25 20:18:17 [DEBUG   ] summary = ERROR
2018-10-25 20:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270468  13 58416 73097505 A  ERRORERROR'
2018-10-25 20:18:17 [DEBUG   ] Got command RPT from MCS: ref #270469
2018-10-25 20:18:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270469  84 58416 73097709 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:18:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:18:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:18:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:18:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:18:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:18:17 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-25 20:18:17 [DEBUG   ] Got command RPT from MCS: ref #270470
2018-10-25 20:18:17 [DEBUG   ] summary = ERROR
2018-10-25 20:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270470  13 58416 73097913 A  ERRORERROR'
2018-10-25 20:18:18 [DEBUG   ] Got command RPT from MCS: ref #270471
2018-10-25 20:18:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270471  84 58416 73098117 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:18:18 [DEBUG   ] Got command RPT from MCS: ref #270472
2018-10-25 20:18:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270472  12 58416 73098309 A  ERRORB•™š'
2018-10-25 20:18:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 20:18:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:19:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:19:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:19:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:19:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:19:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:19:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:19:17 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-10-25 20:19:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 20:19:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:20:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 20:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:20:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:20:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:20:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:20:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:20:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:20:17 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-25 20:20:33 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-25 20:20:37 [DEBUG   ] Got command RPT from MCS: ref #270477
2018-10-25 20:20:37 [DEBUG   ] summary = ERROR
2018-10-25 20:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270477  13 58416 73237153 A  ERRORERROR'
2018-10-25 20:20:37 [DEBUG   ] Got command RPT from MCS: ref #270478
2018-10-25 20:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270478  84 58416 73237154 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:20:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 20:21:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 20:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:21:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:21:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:21:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:21:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:21:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:21:17 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-25 20:21:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:21:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:22:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:22:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:22:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:22:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:22:17 [WARNING ] (13, 1, 'bot')
2018-10-25 20:22:17 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:22:17 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-25 20:22:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:22:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:23:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 20:23:17 [DEBUG   ] Got command RPT from MCS: ref #270500
2018-10-25 20:23:17 [DEBUG   ] summary = ERROR
2018-10-25 20:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270500  13 58416 73397597 A  ERRORERROR'
2018-10-25 20:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:23:17 [DEBUG   ] Got command RPT from MCS: ref #270501
2018-10-25 20:23:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270501  84 58416 73397801 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:23:17 [DEBUG   ] Got command RPT from MCS: ref #270502
2018-10-25 20:23:17 [DEBUG   ] summary = ERROR
2018-10-25 20:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270502  13 58416 73397993 A  ERRORERROR'
2018-10-25 20:23:18 [DEBUG   ] Got command RPT from MCS: ref #270504
2018-10-25 20:23:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270504  84 58416 73398197 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:23:18 [DEBUG   ] Got command RPT from MCS: ref #270506
2018-10-25 20:23:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270506  12 58416 73398401 A  ERRORBŽÌÍ'
2018-10-25 20:23:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:23:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:23:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:23:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:23:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:23:18 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-10-25 20:23:33 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-10-25 20:23:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 20:24:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 20:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:24:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:24:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:24:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:24:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:24:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:24:18 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-25 20:24:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:24:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:25:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 20:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:25:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:25:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:25:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:25:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:25:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:25:18 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-25 20:25:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 20:25:37 [DEBUG   ] Got command RPT from MCS: ref #270514
2018-10-25 20:25:37 [DEBUG   ] summary = ERROR
2018-10-25 20:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270514  13 58416 73537157 A  ERRORERROR'
2018-10-25 20:25:37 [DEBUG   ] Got command RPT from MCS: ref #270515
2018-10-25 20:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270515  84 58416 73537158 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:25:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 20:26:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 20:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:26:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:26:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:26:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:26:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:26:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:26:18 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-25 20:26:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:26:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:27:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:27:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:27:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:27:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:27:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:27:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:27:18 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-10-25 20:27:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:27:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:28:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 20:28:17 [DEBUG   ] Got command RPT from MCS: ref #270531
2018-10-25 20:28:17 [DEBUG   ] summary = ERROR
2018-10-25 20:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270531  13 58416 73697681 A  ERRORERROR'
2018-10-25 20:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:28:17 [DEBUG   ] Got command RPT from MCS: ref #270532
2018-10-25 20:28:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270532  84 58416 73697889 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:28:18 [DEBUG   ] Got command RPT from MCS: ref #270533
2018-10-25 20:28:18 [DEBUG   ] summary = ERROR
2018-10-25 20:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270533  13 58416 73698085 A  ERRORERROR'
2018-10-25 20:28:18 [DEBUG   ] Got command RPT from MCS: ref #270534
2018-10-25 20:28:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270534  84 58416 73698289 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:28:18 [DEBUG   ] Got command RPT from MCS: ref #270535
2018-10-25 20:28:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270535  12 58416 73698481 A  ERRORB”™š'
2018-10-25 20:28:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:28:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:28:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:28:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:28:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:28:18 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-10-25 20:28:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 20:28:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 20:29:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 20:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:29:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:29:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:29:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:29:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:29:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:29:18 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-25 20:29:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:29:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 20:30:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:30:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:30:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:30:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:30:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:30:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:30:18 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-25 20:30:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:30:37 [DEBUG   ] Got command RPT from MCS: ref #270540
2018-10-25 20:30:37 [DEBUG   ] summary = ERROR
2018-10-25 20:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270540  13 58416 73837157 A  ERRORERROR'
2018-10-25 20:30:37 [DEBUG   ] Got command RPT from MCS: ref #270541
2018-10-25 20:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270541  84 58416 73837158 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:30:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:31:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 20:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:31:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:31:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:31:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:31:18 [WARNING ] (13, 1, 'bot')
2018-10-25 20:31:18 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:31:18 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-25 20:31:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 20:31:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 20:32:15 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 20:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:32:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:32:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:32:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:32:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:32:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:32:19 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-10-25 20:32:35 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2018-10-25 20:32:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 20:33:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 20:33:17 [DEBUG   ] Got command RPT from MCS: ref #270563
2018-10-25 20:33:17 [DEBUG   ] summary = ERROR
2018-10-25 20:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270563  13 58416 73997769 A  ERRORERROR'
2018-10-25 20:33:17 [DEBUG   ] Got command RPT from MCS: ref #270564
2018-10-25 20:33:17 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270564  84 58416 73997961 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:33:18 [DEBUG   ] Got command RPT from MCS: ref #270565
2018-10-25 20:33:18 [DEBUG   ] summary = ERROR
2018-10-25 20:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270565  13 58416 73998169 A  ERRORERROR'
2018-10-25 20:33:18 [DEBUG   ] Got command RPT from MCS: ref #270566
2018-10-25 20:33:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270566  84 58416 73998365 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:33:18 [DEBUG   ] Got command RPT from MCS: ref #270568
2018-10-25 20:33:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270568  12 58416 73998573 A  ERRORBŠÌÍ'
2018-10-25 20:33:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:33:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:33:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:33:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:33:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:33:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:33:19 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-25 20:33:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:33:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:34:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:34:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:34:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:34:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:34:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:34:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:34:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:34:19 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-25 20:34:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 20:34:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 20:35:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:35:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:35:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:35:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:35:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:35:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:35:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:35:19 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-25 20:35:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 20:35:37 [DEBUG   ] Got command RPT from MCS: ref #270577
2018-10-25 20:35:37 [DEBUG   ] summary = ERROR
2018-10-25 20:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270577  13 58416 74137165 A  ERRORERROR'
2018-10-25 20:35:37 [DEBUG   ] Got command RPT from MCS: ref #270578
2018-10-25 20:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270578  84 58416 74137166 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:35:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:36:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 20:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:36:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:36:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:36:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:36:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:36:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:36:19 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-25 20:36:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 20:36:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:37:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:37:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:37:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:37:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:37:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:37:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:37:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:37:19 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-25 20:37:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:37:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 20:38:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 20:38:17 [DEBUG   ] Got command RPT from MCS: ref #270598
2018-10-25 20:38:17 [DEBUG   ] summary = ERROR
2018-10-25 20:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270598  13 58416 74297845 A  ERRORERROR'
2018-10-25 20:38:18 [DEBUG   ] Got command RPT from MCS: ref #270599
2018-10-25 20:38:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270599  84 58416 74298049 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:38:18 [DEBUG   ] Got command RPT from MCS: ref #270600
2018-10-25 20:38:18 [DEBUG   ] summary = ERROR
2018-10-25 20:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270600  13 58416 74298257 A  ERRORERROR'
2018-10-25 20:38:18 [DEBUG   ] Got command RPT from MCS: ref #270601
2018-10-25 20:38:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270601  84 58416 74298453 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:38:18 [DEBUG   ] Got command RPT from MCS: ref #270602
2018-10-25 20:38:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270602  12 58416 74298649 A  ERRORBŠÌÍ'
2018-10-25 20:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:38:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:38:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:38:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:38:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:38:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:38:19 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-10-25 20:38:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:38:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:39:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 20:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:39:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:39:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:39:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:39:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:39:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:39:19 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-10-25 20:39:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 20:39:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:40:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 20:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:40:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 20:40:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:40:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:40:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:40:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:40:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:40:19 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-25 20:40:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 20:40:37 [DEBUG   ] Got command RPT from MCS: ref #270607
2018-10-25 20:40:37 [DEBUG   ] summary = ERROR
2018-10-25 20:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270607  13 58416 74437157 A  ERRORERROR'
2018-10-25 20:40:37 [DEBUG   ] Got command RPT from MCS: ref #270608
2018-10-25 20:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270608  84 58416 74437158 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:40:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:41:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 20:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:41:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:41:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:41:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:41:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:41:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:41:19 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-10-25 20:41:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 20:41:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 20:42:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 20:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:42:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:42:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:42:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:42:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:42:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:42:19 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-25 20:42:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 20:42:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:43:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:43:17 [DEBUG   ] Got command RPT from MCS: ref #270626
2018-10-25 20:43:17 [DEBUG   ] summary = ERROR
2018-10-25 20:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270626  13 58416 74597941 A  ERRORERROR'
2018-10-25 20:43:18 [DEBUG   ] Got command RPT from MCS: ref #270627
2018-10-25 20:43:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270627  84 58416 74598133 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:43:18 [DEBUG   ] Got command RPT from MCS: ref #270628
2018-10-25 20:43:18 [DEBUG   ] summary = ERROR
2018-10-25 20:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270628  13 58416 74598337 A  ERRORERROR'
2018-10-25 20:43:18 [DEBUG   ] Got command RPT from MCS: ref #270630
2018-10-25 20:43:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270630  84 58416 74598541 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:43:18 [DEBUG   ] Got command RPT from MCS: ref #270632
2018-10-25 20:43:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270632  12 58416 74598733 A  ERRORB�'
2018-10-25 20:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:43:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:43:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:43:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:43:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:43:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:43:19 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-25 20:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:43:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:44:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 20:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:44:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:44:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:44:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:44:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:44:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:44:19 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-25 20:44:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 20:44:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 20:45:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:45:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:45:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:45:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:45:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:45:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:45:19 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-25 20:45:37 [DEBUG   ] Got command RPT from MCS: ref #270640
2018-10-25 20:45:37 [DEBUG   ] summary = ERROR
2018-10-25 20:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270640  13 58416 74737169 A  ERRORERROR'
2018-10-25 20:45:37 [DEBUG   ] Got command RPT from MCS: ref #270641
2018-10-25 20:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270641  84 58416 74737170 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:45:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:45:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 20:46:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:46:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:46:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:46:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:46:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:46:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:46:19 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-25 20:46:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:46:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 20:47:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 20:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:47:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:47:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:47:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:47:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:47:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:47:19 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-10-25 20:47:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 20:47:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:48:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 20:48:18 [DEBUG   ] Got command RPT from MCS: ref #270661
2018-10-25 20:48:18 [DEBUG   ] summary = ERROR
2018-10-25 20:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270661  13 58416 74898025 A  ERRORERROR'
2018-10-25 20:48:18 [DEBUG   ] Got command RPT from MCS: ref #270662
2018-10-25 20:48:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270662  84 58416 74898229 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:48:18 [DEBUG   ] Got command RPT from MCS: ref #270663
2018-10-25 20:48:18 [DEBUG   ] summary = ERROR
2018-10-25 20:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270663  13 58416 74898421 A  ERRORERROR'
2018-10-25 20:48:18 [DEBUG   ] Got command RPT from MCS: ref #270664
2018-10-25 20:48:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270664  84 58416 74898625 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:48:18 [DEBUG   ] Got command RPT from MCS: ref #270665
2018-10-25 20:48:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270665  12 58416 74898829 A  ERRORB€'
2018-10-25 20:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:48:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:48:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:48:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:48:19 [WARNING ] (13, 1, 'bot')
2018-10-25 20:48:19 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:48:19 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-10-25 20:48:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:48:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 20:49:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 20:49:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:49:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:49:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:49:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:49:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:49:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:49:20 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-10-25 20:49:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 20:49:57 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-25 20:50:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 20:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:50:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:50:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:50:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:50:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:50:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:50:20 [DEBUG   ] Finished updating board flags in 1.945 seconds
2018-10-25 20:50:37 [DEBUG   ] Got command RPT from MCS: ref #270670
2018-10-25 20:50:37 [DEBUG   ] summary = ERROR
2018-10-25 20:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270670  13 58416 75037166 A  ERRORERROR'
2018-10-25 20:50:37 [DEBUG   ] Got command RPT from MCS: ref #270671
2018-10-25 20:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270671  84 58416 75037166 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:50:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 20:50:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:51:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:51:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 20:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:51:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:51:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:51:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:51:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:51:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:51:20 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-25 20:51:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 20:51:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-25 20:52:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 20:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:52:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:52:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:52:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:52:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:52:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:52:20 [DEBUG   ] Finished updating board flags in 1.855 seconds
2018-10-25 20:52:38 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-25 20:52:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 20:53:18 [DEBUG   ] Got command RPT from MCS: ref #270693
2018-10-25 20:53:18 [DEBUG   ] summary = ERROR
2018-10-25 20:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270693  13 58416 75198105 A  ERRORERROR'
2018-10-25 20:53:18 [DEBUG   ] Got command RPT from MCS: ref #270694
2018-10-25 20:53:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270694  84 58416 75198310 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:53:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 20:53:18 [DEBUG   ] Got command RPT from MCS: ref #270695
2018-10-25 20:53:18 [DEBUG   ] summary = ERROR
2018-10-25 20:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270695  13 58416 75198513 A  ERRORERROR'
2018-10-25 20:53:18 [DEBUG   ] Got command RPT from MCS: ref #270697
2018-10-25 20:53:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270697  84 58416 75198705 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:53:18 [DEBUG   ] Got command RPT from MCS: ref #270699
2018-10-25 20:53:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270699  12 58416 75198914 A  ERRORB–™š'
2018-10-25 20:53:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:53:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:53:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:53:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:53:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:53:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:53:20 [DEBUG   ] Finished updating board flags in 1.748 seconds
2018-10-25 20:53:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 20:53:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 20:54:19 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2018-10-25 20:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 20:54:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 20:54:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:54:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:54:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:54:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:54:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:54:20 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-25 20:54:39 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-10-25 20:54:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 20:55:19 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2018-10-25 20:55:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 20:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:55:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:55:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:55:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:55:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:55:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:55:20 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-25 20:55:37 [DEBUG   ] Got command RPT from MCS: ref #270707
2018-10-25 20:55:37 [DEBUG   ] summary = ERROR
2018-10-25 20:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270707  13 58416 75337161 A  ERRORERROR'
2018-10-25 20:55:37 [DEBUG   ] Got command RPT from MCS: ref #270708
2018-10-25 20:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270708  84 58416 75337162 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:55:39 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-10-25 20:55:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 20:56:19 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-10-25 20:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:56:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:56:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:56:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:56:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:56:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:56:20 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-25 20:56:39 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-10-25 20:56:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 20:57:19 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-10-25 20:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:57:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:57:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:57:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:57:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:57:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:57:20 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-25 20:57:40 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-10-25 20:58:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 20:58:18 [DEBUG   ] Got command RPT from MCS: ref #270724
2018-10-25 20:58:18 [DEBUG   ] summary = ERROR
2018-10-25 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270724  13 58416 75498193 A  ERRORERROR'
2018-10-25 20:58:18 [DEBUG   ] Got command RPT from MCS: ref #270725
2018-10-25 20:58:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270725  84 58416 75498397 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:58:18 [DEBUG   ] Got command RPT from MCS: ref #270726
2018-10-25 20:58:18 [DEBUG   ] summary = ERROR
2018-10-25 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270726  13 58416 75498589 A  ERRORERROR'
2018-10-25 20:58:18 [DEBUG   ] Got command RPT from MCS: ref #270727
2018-10-25 20:58:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270727  84 58416 75498793 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 20:58:18 [DEBUG   ] Got command RPT from MCS: ref #270728
2018-10-25 20:58:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270728  12 58416 75498997 A  ERRORB˜™š'
2018-10-25 20:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:58:20 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-25 20:58:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:58:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:58:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:58:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:58:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:58:20 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-25 20:58:40 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-10-25 20:59:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 20:59:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 20:59:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 20:59:20 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-10-25 20:59:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:59:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:59:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:59:20 [WARNING ] (13, 1, 'bot')
2018-10-25 20:59:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 20:59:20 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-10-25 20:59:40 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-10-25 21:00:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 21:00:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 21:00:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:00:20 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-10-25 21:00:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:00:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:00:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:00:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:00:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:00:20 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-25 21:00:37 [DEBUG   ] Got command RPT from MCS: ref #270733
2018-10-25 21:00:37 [DEBUG   ] summary = ERROR
2018-10-25 21:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270733  13 58416 75637161 A  ERRORERROR'
2018-10-25 21:00:37 [DEBUG   ] Got command RPT from MCS: ref #270734
2018-10-25 21:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270734  84 58416 75637162 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:00:40 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-25 21:01:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 21:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:01:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 21:01:20 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2018-10-25 21:01:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:01:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:01:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:01:20 [WARNING ] (13, 1, 'bot')
2018-10-25 21:01:20 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:01:20 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-10-25 21:01:41 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-10-25 21:02:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 21:02:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:02:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:02:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:02:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:02:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:02:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:02:22 [DEBUG   ] Finished updating board flags in 3.154 seconds
2018-10-25 21:02:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 21:03:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:03:18 [DEBUG   ] Got command RPT from MCS: ref #270756
2018-10-25 21:03:18 [DEBUG   ] summary = ERROR
2018-10-25 21:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270756  13 58416 75798281 A  ERRORERROR'
2018-10-25 21:03:18 [DEBUG   ] Got command RPT from MCS: ref #270757
2018-10-25 21:03:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270757  84 58416 75798473 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:03:18 [DEBUG   ] Got command RPT from MCS: ref #270758
2018-10-25 21:03:18 [DEBUG   ] summary = ERROR
2018-10-25 21:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270758  13 58416 75798677 A  ERRORERROR'
2018-10-25 21:03:18 [DEBUG   ] Got command RPT from MCS: ref #270759
2018-10-25 21:03:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270759  84 58416 75798881 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:03:19 [DEBUG   ] Got command RPT from MCS: ref #270761
2018-10-25 21:03:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270761  12 58416 75799073 A  ERRORB—™š'
2018-10-25 21:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:03:21 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-25 21:03:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:03:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:03:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:03:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:03:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:03:21 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-10-25 21:03:41 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-10-25 21:04:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 21:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:04:21 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-10-25 21:04:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:04:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:04:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:04:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:04:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:04:21 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-25 21:04:41 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-10-25 21:05:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 21:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:05:21 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-10-25 21:05:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:05:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:05:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:05:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:05:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:05:21 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-10-25 21:05:37 [DEBUG   ] Got command RPT from MCS: ref #270770
2018-10-25 21:05:37 [DEBUG   ] summary = ERROR
2018-10-25 21:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270770  13 58416 75937169 A  ERRORERROR'
2018-10-25 21:05:37 [DEBUG   ] Got command RPT from MCS: ref #270771
2018-10-25 21:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270771  84 58416 75937170 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:05:41 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-25 21:06:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 21:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:06:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:06:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:06:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:06:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:06:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:06:21 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-25 21:06:22 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-25 21:06:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 21:07:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 21:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:07:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:07:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:07:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:07:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:07:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:07:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:07:21 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-25 21:07:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 21:07:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 21:08:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 21:08:18 [DEBUG   ] Got command RPT from MCS: ref #270791
2018-10-25 21:08:18 [DEBUG   ] summary = ERROR
2018-10-25 21:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270791  13 58416 76098357 A  ERRORERROR'
2018-10-25 21:08:18 [DEBUG   ] Got command RPT from MCS: ref #270792
2018-10-25 21:08:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270792  84 58416 76098561 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:08:18 [DEBUG   ] Got command RPT from MCS: ref #270793
2018-10-25 21:08:18 [DEBUG   ] summary = ERROR
2018-10-25 21:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270793  13 58416 76098765 A  ERRORERROR'
2018-10-25 21:08:18 [DEBUG   ] Got command RPT from MCS: ref #270794
2018-10-25 21:08:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270794  84 58416 76098957 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:08:19 [DEBUG   ] Got command RPT from MCS: ref #270795
2018-10-25 21:08:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270795  12 58416 76099161 A  ERRORB—™š'
2018-10-25 21:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:08:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-25 21:08:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:08:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:08:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:08:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:08:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:08:22 [DEBUG   ] Finished updating board flags in 2.346 seconds
2018-10-25 21:08:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 21:09:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 21:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:09:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:09:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:09:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:09:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:09:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:09:21 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-10-25 21:09:22 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-25 21:09:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:10:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 21:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:10:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:10:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:10:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:10:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:10:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:10:21 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-25 21:10:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:10:37 [DEBUG   ] Got command RPT from MCS: ref #270800
2018-10-25 21:10:37 [DEBUG   ] summary = ERROR
2018-10-25 21:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270800  13 58416 76237173 A  ERRORERROR'
2018-10-25 21:10:37 [DEBUG   ] Got command RPT from MCS: ref #270801
2018-10-25 21:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270801  84 58416 76237174 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:10:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:11:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 21:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:11:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:11:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:11:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:11:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:11:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:11:21 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-25 21:11:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 21:11:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 21:12:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:12:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:12:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:12:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:12:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:12:21 [WARNING ] (13, 1, 'bot')
2018-10-25 21:12:21 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:12:21 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-10-25 21:12:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:12:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 21:13:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 21:13:18 [DEBUG   ] Got command RPT from MCS: ref #270819
2018-10-25 21:13:18 [DEBUG   ] summary = ERROR
2018-10-25 21:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270819  13 58416 76398445 A  ERRORERROR'
2018-10-25 21:13:18 [DEBUG   ] Got command RPT from MCS: ref #270820
2018-10-25 21:13:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270820  84 58416 76398649 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:13:18 [DEBUG   ] Got command RPT from MCS: ref #270821
2018-10-25 21:13:18 [DEBUG   ] summary = ERROR
2018-10-25 21:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270821  13 58416 76398841 A  ERRORERROR'
2018-10-25 21:13:19 [DEBUG   ] Got command RPT from MCS: ref #270823
2018-10-25 21:13:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270823  84 58416 76399045 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:13:19 [DEBUG   ] Got command RPT from MCS: ref #270825
2018-10-25 21:13:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270825  12 58416 76399249 A  ERRORB–™š'
2018-10-25 21:13:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:13:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:13:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:13:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:13:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:13:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:13:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:13:22 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-25 21:13:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 21:13:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:14:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 21:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:14:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:14:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:14:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:14:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:14:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:14:22 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-10-25 21:14:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 21:14:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 21:15:04 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-25 21:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:15:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:15:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:15:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:15:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:15:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:15:22 [DEBUG   ] Finished updating board flags in 1.919 seconds
2018-10-25 21:15:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 21:15:37 [DEBUG   ] Got command RPT from MCS: ref #270833
2018-10-25 21:15:37 [DEBUG   ] summary = ERROR
2018-10-25 21:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270833  13 58416 76537169 A  ERRORERROR'
2018-10-25 21:15:37 [DEBUG   ] Got command RPT from MCS: ref #270834
2018-10-25 21:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270834  84 58416 76537170 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:15:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 21:16:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:16:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:16:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:16:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:16:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:16:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:16:22 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-25 21:16:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:16:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:17:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:17:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:17:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:17:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:17:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:17:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:17:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:17:22 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-25 21:17:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 21:17:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 21:18:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:18:18 [DEBUG   ] Got command RPT from MCS: ref #270854
2018-10-25 21:18:18 [DEBUG   ] summary = ERROR
2018-10-25 21:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270854  13 58416 76698525 A  ERRORERROR'
2018-10-25 21:18:18 [DEBUG   ] Got command RPT from MCS: ref #270855
2018-10-25 21:18:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270855  84 58416 76698729 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:18:18 [DEBUG   ] Got command RPT from MCS: ref #270856
2018-10-25 21:18:18 [DEBUG   ] summary = ERROR
2018-10-25 21:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270856  13 58416 76698933 A  ERRORERROR'
2018-10-25 21:18:19 [DEBUG   ] Got command RPT from MCS: ref #270857
2018-10-25 21:18:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270857  84 58416 76699125 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:18:19 [DEBUG   ] Got command RPT from MCS: ref #270858
2018-10-25 21:18:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270858  12 58416 76699329 A  ERRORB–™š'
2018-10-25 21:18:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:18:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:18:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:18:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:18:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:18:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:18:22 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-25 21:18:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:18:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 21:19:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 21:19:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:19:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:19:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:19:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:19:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:19:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:19:22 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-25 21:19:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 21:19:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 21:20:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:20:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:20:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:20:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:20:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:20:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:20:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:20:22 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-25 21:20:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 21:20:37 [DEBUG   ] Got command RPT from MCS: ref #270863
2018-10-25 21:20:37 [DEBUG   ] summary = ERROR
2018-10-25 21:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270863  13 58416 76837177 A  ERRORERROR'
2018-10-25 21:20:37 [DEBUG   ] Got command RPT from MCS: ref #270864
2018-10-25 21:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270864  84 58416 76837178 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:20:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 21:21:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 21:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:21:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:21:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:21:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:21:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:21:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:21:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-25 21:21:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:21:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:22:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:22:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:22:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:22:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:22:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:22:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:22:22 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-25 21:22:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:22:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 21:23:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:23:18 [DEBUG   ] Got command RPT from MCS: ref #270886
2018-10-25 21:23:18 [DEBUG   ] summary = ERROR
2018-10-25 21:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270886  13 58416 76998613 A  ERRORERROR'
2018-10-25 21:23:18 [DEBUG   ] Got command RPT from MCS: ref #270887
2018-10-25 21:23:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270887  84 58416 76998817 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:23:19 [DEBUG   ] Got command RPT from MCS: ref #270888
2018-10-25 21:23:19 [DEBUG   ] summary = ERROR
2018-10-25 21:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270888  13 58416 76999021 A  ERRORERROR'
2018-10-25 21:23:19 [DEBUG   ] Got command RPT from MCS: ref #270890
2018-10-25 21:23:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270890  84 58416 76999213 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:23:19 [DEBUG   ] Got command RPT from MCS: ref #270892
2018-10-25 21:23:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270892  12 58416 76999417 A  ERRORB•™š'
2018-10-25 21:23:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:23:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:23:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:23:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:23:22 [WARNING ] (13, 1, 'bot')
2018-10-25 21:23:22 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:23:22 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-25 21:23:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:23:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:24:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 21:24:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:24:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:24:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:24:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:24:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:24:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:24:23 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-10-25 21:24:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 21:24:46 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2018-10-25 21:25:05 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2018-10-25 21:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:25:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:25:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:25:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:25:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:25:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:25:23 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-25 21:25:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-25 21:25:37 [DEBUG   ] Got command RPT from MCS: ref #270900
2018-10-25 21:25:37 [DEBUG   ] summary = ERROR
2018-10-25 21:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270900  13 58416 77137169 A  ERRORERROR'
2018-10-25 21:25:37 [DEBUG   ] Got command RPT from MCS: ref #270901
2018-10-25 21:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270901  84 58416 77137170 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:25:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 21:26:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:26:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:26:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:26:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:26:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:26:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:26:23 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-25 21:26:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:26:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 21:27:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:27:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:27:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:27:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:27:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:27:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:27:23 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-25 21:27:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 21:27:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 21:28:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 21:28:18 [DEBUG   ] Got command RPT from MCS: ref #270917
2018-10-25 21:28:18 [DEBUG   ] summary = ERROR
2018-10-25 21:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270917  13 58416 77298705 A  ERRORERROR'
2018-10-25 21:28:18 [DEBUG   ] Got command RPT from MCS: ref #270918
2018-10-25 21:28:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270918  84 58416 77298897 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:28:19 [DEBUG   ] Got command RPT from MCS: ref #270919
2018-10-25 21:28:19 [DEBUG   ] summary = ERROR
2018-10-25 21:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270919  13 58416 77299101 A  ERRORERROR'
2018-10-25 21:28:19 [DEBUG   ] Got command RPT from MCS: ref #270920
2018-10-25 21:28:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270920  84 58416 77299305 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:28:19 [DEBUG   ] Got command RPT from MCS: ref #270921
2018-10-25 21:28:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270921  12 58416 77299509 A  ERRORB•™š'
2018-10-25 21:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:28:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:28:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:28:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:28:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:28:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:28:23 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-25 21:28:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 21:28:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:29:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 21:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:29:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:29:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:29:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:29:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:29:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:29:23 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-10-25 21:29:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 21:29:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 21:30:07 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-25 21:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:30:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:30:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:30:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:30:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:30:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:30:23 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-10-25 21:30:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 21:30:37 [DEBUG   ] Got command RPT from MCS: ref #270926
2018-10-25 21:30:37 [DEBUG   ] summary = ERROR
2018-10-25 21:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270926  13 58416 77437169 A  ERRORERROR'
2018-10-25 21:30:37 [DEBUG   ] Got command RPT from MCS: ref #270927
2018-10-25 21:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270927  84 58416 77437170 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:30:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:31:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:31:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:31:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:31:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:31:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:31:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:31:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:31:23 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-25 21:31:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 21:31:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:32:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 21:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:32:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:32:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:32:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:32:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:32:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:32:23 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-25 21:32:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-25 21:32:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 21:33:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 21:33:18 [DEBUG   ] Got command RPT from MCS: ref #270949
2018-10-25 21:33:18 [DEBUG   ] summary = ERROR
2018-10-25 21:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270949  13 58416 77598789 A  ERRORERROR'
2018-10-25 21:33:18 [DEBUG   ] Got command RPT from MCS: ref #270950
2018-10-25 21:33:18 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270950  84 58416 77598981 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:33:19 [DEBUG   ] Got command RPT from MCS: ref #270951
2018-10-25 21:33:19 [DEBUG   ] summary = ERROR
2018-10-25 21:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270951  13 58416 77599185 A  ERRORERROR'
2018-10-25 21:33:19 [DEBUG   ] Got command RPT from MCS: ref #270953
2018-10-25 21:33:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270953  84 58416 77599389 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:33:19 [DEBUG   ] Got command RPT from MCS: ref #270955
2018-10-25 21:33:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270955  12 58416 77599581 A  ERRORB•™š'
2018-10-25 21:33:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:33:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:33:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:33:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:33:23 [WARNING ] (13, 1, 'bot')
2018-10-25 21:33:23 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:33:23 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-25 21:33:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 21:33:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 21:34:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 21:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:34:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:34:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:34:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:34:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:34:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:34:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:34:24 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-10-25 21:34:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:34:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 21:35:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:35:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:35:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:35:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:35:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:35:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:35:24 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-25 21:35:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:35:37 [DEBUG   ] Got command RPT from MCS: ref #270963
2018-10-25 21:35:37 [DEBUG   ] summary = ERROR
2018-10-25 21:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270963  13 58416 77737173 A  ERRORERROR'
2018-10-25 21:35:37 [DEBUG   ] Got command RPT from MCS: ref #270964
2018-10-25 21:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270964  84 58416 77737174 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:35:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:36:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 21:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:36:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:36:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:36:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:36:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:36:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:36:24 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-25 21:36:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 21:36:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:37:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 21:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:37:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:37:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:37:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:37:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:37:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:37:24 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-25 21:37:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-25 21:37:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 21:38:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:38:18 [DEBUG   ] Got command RPT from MCS: ref #270984
2018-10-25 21:38:18 [DEBUG   ] summary = ERROR
2018-10-25 21:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270984  13 58416 77898869 A  ERRORERROR'
2018-10-25 21:38:19 [DEBUG   ] Got command RPT from MCS: ref #270985
2018-10-25 21:38:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270985  84 58416 77899073 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:38:19 [DEBUG   ] Got command RPT from MCS: ref #270986
2018-10-25 21:38:19 [DEBUG   ] summary = ERROR
2018-10-25 21:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270986  13 58416 77899277 A  ERRORERROR'
2018-10-25 21:38:19 [DEBUG   ] Got command RPT from MCS: ref #270987
2018-10-25 21:38:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270987  84 58416 77899469 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:38:19 [DEBUG   ] Got command RPT from MCS: ref #270988
2018-10-25 21:38:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270988  12 58416 77899673 A  ERRORB”™š'
2018-10-25 21:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:38:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:38:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:38:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:38:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:38:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:38:24 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-25 21:38:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 21:38:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 21:39:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:39:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:39:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:39:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:39:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:39:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:39:24 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-25 21:39:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 21:39:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:40:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:40:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:40:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:40:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:40:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:40:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:40:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:40:24 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-10-25 21:40:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:40:37 [DEBUG   ] Got command RPT from MCS: ref #270993
2018-10-25 21:40:37 [DEBUG   ] summary = ERROR
2018-10-25 21:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270993  13 58416 78037181 A  ERRORERROR'
2018-10-25 21:40:37 [DEBUG   ] Got command RPT from MCS: ref #270994
2018-10-25 21:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   270994  84 58416 78037182 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:40:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:41:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 21:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:41:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:41:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:41:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:41:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:41:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:41:24 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-25 21:41:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:41:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:42:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:42:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:42:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:42:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:42:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:42:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:42:24 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-25 21:42:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 21:42:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 21:43:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:43:18 [DEBUG   ] Got command RPT from MCS: ref #271012
2018-10-25 21:43:18 [DEBUG   ] summary = ERROR
2018-10-25 21:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271012  13 58416 78198957 A  ERRORERROR'
2018-10-25 21:43:19 [DEBUG   ] Got command RPT from MCS: ref #271013
2018-10-25 21:43:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271013  84 58416 78199161 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:43:19 [DEBUG   ] Got command RPT from MCS: ref #271014
2018-10-25 21:43:19 [DEBUG   ] summary = ERROR
2018-10-25 21:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271014  13 58416 78199353 A  ERRORERROR'
2018-10-25 21:43:19 [DEBUG   ] Got command RPT from MCS: ref #271016
2018-10-25 21:43:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271016  84 58416 78199557 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:43:19 [DEBUG   ] Got command RPT from MCS: ref #271017
2018-10-25 21:43:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271017  12 58416 78199761 A  ERRORB”™š'
2018-10-25 21:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:43:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:43:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:43:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:43:24 [WARNING ] (13, 1, 'bot')
2018-10-25 21:43:24 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:43:24 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-25 21:43:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 21:43:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 21:44:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 21:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:44:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:44:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:44:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:44:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:44:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:44:25 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-10-25 21:44:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 21:44:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 21:45:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:45:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:45:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:45:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:45:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:45:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:45:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:45:25 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-25 21:45:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:45:37 [DEBUG   ] Got command RPT from MCS: ref #271026
2018-10-25 21:45:37 [DEBUG   ] summary = ERROR
2018-10-25 21:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271026  13 58416 78337173 A  ERRORERROR'
2018-10-25 21:45:37 [DEBUG   ] Got command RPT from MCS: ref #271027
2018-10-25 21:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271027  84 58416 78337174 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:45:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 21:46:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 21:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:46:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:46:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:46:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:46:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:46:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:46:25 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-25 21:46:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 21:46:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:47:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 21:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:47:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:47:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:47:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:47:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:47:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:47:25 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-10-25 21:47:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 21:47:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 21:48:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 21:48:19 [DEBUG   ] Got command RPT from MCS: ref #271047
2018-10-25 21:48:19 [DEBUG   ] summary = ERROR
2018-10-25 21:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271047  13 58416 78499037 A  ERRORERROR'
2018-10-25 21:48:19 [DEBUG   ] Got command RPT from MCS: ref #271048
2018-10-25 21:48:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271048  84 58416 78499241 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:48:19 [DEBUG   ] Got command RPT from MCS: ref #271049
2018-10-25 21:48:19 [DEBUG   ] summary = ERROR
2018-10-25 21:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271049  13 58416 78499445 A  ERRORERROR'
2018-10-25 21:48:19 [DEBUG   ] Got command RPT from MCS: ref #271050
2018-10-25 21:48:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271050  84 58416 78499637 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:48:19 [DEBUG   ] Got command RPT from MCS: ref #271051
2018-10-25 21:48:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271051  12 58416 78499841 A  ERRORB”™š'
2018-10-25 21:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:48:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:48:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:48:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:48:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:48:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:48:25 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-25 21:48:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 21:48:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 21:49:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 21:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:49:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:49:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:49:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:49:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:49:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:49:25 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-25 21:49:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-25 21:49:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 21:50:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:50:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:50:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:50:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:50:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:50:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:50:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:50:25 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-25 21:50:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-25 21:50:37 [DEBUG   ] Got command RPT from MCS: ref #271056
2018-10-25 21:50:37 [DEBUG   ] summary = ERROR
2018-10-25 21:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271056  13 58416 78637181 A  ERRORERROR'
2018-10-25 21:50:37 [DEBUG   ] Got command RPT from MCS: ref #271057
2018-10-25 21:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271057  84 58416 78637182 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:50:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 21:51:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:51:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:51:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:51:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:51:25 [WARNING ] (13, 1, 'bot')
2018-10-25 21:51:25 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:51:25 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-10-25 21:51:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:51:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:52:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:52:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:52:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:52:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:52:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:52:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:52:26 [DEBUG   ] Finished updating board flags in 2.130 seconds
2018-10-25 21:52:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:52:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:53:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:53:19 [DEBUG   ] Got command RPT from MCS: ref #271079
2018-10-25 21:53:19 [DEBUG   ] summary = ERROR
2018-10-25 21:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271079  13 58416 78799121 A  ERRORERROR'
2018-10-25 21:53:19 [DEBUG   ] Got command RPT from MCS: ref #271080
2018-10-25 21:53:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271080  84 58416 78799325 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:53:19 [DEBUG   ] Got command RPT from MCS: ref #271081
2018-10-25 21:53:19 [DEBUG   ] summary = ERROR
2018-10-25 21:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271081  13 58416 78799529 A  ERRORERROR'
2018-10-25 21:53:19 [DEBUG   ] Got command RPT from MCS: ref #271083
2018-10-25 21:53:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271083  84 58416 78799733 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:53:19 [DEBUG   ] Got command RPT from MCS: ref #271084
2018-10-25 21:53:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271084  12 58416 78799925 A  ERRORB“™š'
2018-10-25 21:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:53:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:53:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:53:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:53:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:53:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:53:26 [DEBUG   ] Finished updating board flags in 1.936 seconds
2018-10-25 21:53:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:53:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 21:54:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 21:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:54:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:54:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:54:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:54:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:54:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:54:26 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-25 21:54:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 21:54:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-25 21:55:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 21:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:55:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 21:55:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:55:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:55:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:55:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:55:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:55:26 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-10-25 21:55:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 21:55:37 [DEBUG   ] Got command RPT from MCS: ref #271093
2018-10-25 21:55:37 [DEBUG   ] summary = ERROR
2018-10-25 21:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271093  13 58416 78937177 A  ERRORERROR'
2018-10-25 21:55:37 [DEBUG   ] Got command RPT from MCS: ref #271094
2018-10-25 21:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271094  84 58416 78937178 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:55:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 21:56:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 21:56:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-25 21:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:56:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:56:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:56:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:56:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:56:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:56:26 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-10-25 21:56:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 21:56:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 21:57:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 21:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:57:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:57:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:57:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:57:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:57:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:57:26 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-25 21:57:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 21:57:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 21:58:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-25 21:58:19 [DEBUG   ] Got command RPT from MCS: ref #271110
2018-10-25 21:58:19 [DEBUG   ] summary = ERROR
2018-10-25 21:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271110  13 58416 79099209 A  ERRORERROR'
2018-10-25 21:58:19 [DEBUG   ] Got command RPT from MCS: ref #271111
2018-10-25 21:58:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271111  84 58416 79099413 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:58:19 [DEBUG   ] Got command RPT from MCS: ref #271112
2018-10-25 21:58:19 [DEBUG   ] summary = ERROR
2018-10-25 21:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271112  13 58416 79099617 A  ERRORERROR'
2018-10-25 21:58:19 [DEBUG   ] Got command RPT from MCS: ref #271113
2018-10-25 21:58:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 21:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271113  84 58416 79099821 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 21:58:20 [DEBUG   ] Got command RPT from MCS: ref #271114
2018-10-25 21:58:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271114  12 58416 79100013 A  ERRORB–™š'
2018-10-25 21:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:58:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-25 21:58:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:58:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:58:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:58:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:58:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:58:26 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-25 21:58:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 21:58:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:59:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 21:59:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 21:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 21:59:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 21:59:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:59:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:59:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:59:26 [WARNING ] (13, 1, 'bot')
2018-10-25 21:59:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 21:59:26 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-25 21:59:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 21:59:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:00:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 22:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:00:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:00:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:00:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:00:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:00:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:00:26 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-25 22:00:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:00:37 [DEBUG   ] Got command RPT from MCS: ref #271119
2018-10-25 22:00:37 [DEBUG   ] summary = ERROR
2018-10-25 22:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271119  13 58416 79237177 A  ERRORERROR'
2018-10-25 22:00:37 [DEBUG   ] Got command RPT from MCS: ref #271120
2018-10-25 22:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271120  84 58416 79237178 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:00:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 22:01:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 22:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:01:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:01:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:01:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:01:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:01:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:01:26 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-25 22:01:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 22:01:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-25 22:02:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-25 22:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:02:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:02:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:02:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:02:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:02:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:02:26 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-10-25 22:02:33 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2018-10-25 22:02:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 22:03:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:03:19 [DEBUG   ] Got command RPT from MCS: ref #271142
2018-10-25 22:03:19 [DEBUG   ] summary = ERROR
2018-10-25 22:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271142  13 58416 79399297 A  ERRORERROR'
2018-10-25 22:03:19 [DEBUG   ] Got command RPT from MCS: ref #271143
2018-10-25 22:03:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271143  84 58416 79399501 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:03:19 [DEBUG   ] Got command RPT from MCS: ref #271144
2018-10-25 22:03:19 [DEBUG   ] summary = ERROR
2018-10-25 22:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271144  13 58416 79399705 A  ERRORERROR'
2018-10-25 22:03:19 [DEBUG   ] Got command RPT from MCS: ref #271146
2018-10-25 22:03:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271146  84 58416 79399897 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:03:20 [DEBUG   ] Got command RPT from MCS: ref #271147
2018-10-25 22:03:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271147  12 58416 79400101 A  ERRORB—™š'
2018-10-25 22:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:03:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:03:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:03:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:03:26 [WARNING ] (13, 1, 'bot')
2018-10-25 22:03:26 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:03:26 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-10-25 22:03:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:03:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:04:11 [DEBUG   ] Got command TBW from MCS: ref #271153
2018-10-25 22:04:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-25 22:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   271153   8 58416 79451125 A  ERROR'
2018-10-25 22:04:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-25 22:04:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-25 22:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-25 22:04:14 [DEBUG   ] spawn_process: at 2018-10-25 22:04:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-25 22:04:14 [INFO    ] Finished spawning TBW
2018-10-25 22:04:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 22:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:04:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:04:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:04:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:04:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:04:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:04:27 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-10-25 22:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:05:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:05:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:05:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:05:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:05:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:05:27 [DEBUG   ] Finished updating board flags in 2.111 seconds
2018-10-25 22:05:37 [DEBUG   ] Got command RPT from MCS: ref #271161
2018-10-25 22:05:37 [DEBUG   ] summary = ERROR
2018-10-25 22:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271161  13 58416 79537181 A  ERRORERROR'
2018-10-25 22:05:37 [DEBUG   ] Got command RPT from MCS: ref #271162
2018-10-25 22:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271162  84 58416 79537182 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:06:02 [INFO    ] __waitForTBW - TBW finished in 108.071 s
2018-10-25 22:06:03 [DEBUG   ] Finished updating ant stats in 0.498 seconds
2018-10-25 22:06:03 [INFO    ] Started antennas statistics background thread
2018-10-25 22:06:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540505165']
2018-10-25 22:06:03 [DEBUG   ] spawn_process: at 2018-10-25 22:06:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540505165']
2018-10-25 22:06:03 [INFO    ] Finished spawning TBN in 0.048 s
2018-10-25 22:06:23 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-10-25 22:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:06:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:06:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:06:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:06:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:06:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:06:27 [DEBUG   ] Finished updating board flags in 2.183 seconds
2018-10-25 22:06:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 22:07:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 22:07:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 22:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:07:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:07:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:07:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:07:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:07:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:07:27 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-10-25 22:07:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-25 22:08:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-25 22:08:19 [DEBUG   ] Got command RPT from MCS: ref #271186
2018-10-25 22:08:19 [DEBUG   ] summary = ERROR
2018-10-25 22:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271186  13 58416 79699381 A  ERRORERROR'
2018-10-25 22:08:19 [DEBUG   ] Got command RPT from MCS: ref #271187
2018-10-25 22:08:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271187  84 58416 79699585 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:08:19 [DEBUG   ] Got command RPT from MCS: ref #271188
2018-10-25 22:08:19 [DEBUG   ] summary = ERROR
2018-10-25 22:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271188  13 58416 79699789 A  ERRORERROR'
2018-10-25 22:08:19 [DEBUG   ] Got command RPT from MCS: ref #271189
2018-10-25 22:08:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271189  84 58416 79699981 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:08:20 [DEBUG   ] Got command RPT from MCS: ref #271190
2018-10-25 22:08:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271190  12 58416 79700185 A  ERRORB—™š'
2018-10-25 22:08:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-25 22:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:08:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:08:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:08:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:08:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:08:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:08:27 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-25 22:08:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:09:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:09:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 22:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:09:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:09:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:09:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:09:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:09:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:09:27 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-25 22:09:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 22:10:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:10:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:10:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:10:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:10:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:10:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:10:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:10:27 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-25 22:10:37 [DEBUG   ] Got command RPT from MCS: ref #271195
2018-10-25 22:10:37 [DEBUG   ] summary = ERROR
2018-10-25 22:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271195  13 58416 79837189 A  ERRORERROR'
2018-10-25 22:10:37 [DEBUG   ] Got command RPT from MCS: ref #271196
2018-10-25 22:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271196  84 58416 79837190 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:10:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:11:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:11:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 22:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:11:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:11:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:11:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:11:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:11:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:11:27 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-25 22:11:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:12:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:12:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 22:12:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:12:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:12:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:12:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:12:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:12:27 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-10-25 22:12:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:13:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:13:19 [DEBUG   ] Got command RPT from MCS: ref #271214
2018-10-25 22:13:19 [DEBUG   ] summary = ERROR
2018-10-25 22:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271214  13 58416 79999465 A  ERRORERROR'
2018-10-25 22:13:19 [DEBUG   ] Got command RPT from MCS: ref #271215
2018-10-25 22:13:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271215  84 58416 79999669 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:13:19 [DEBUG   ] Got command RPT from MCS: ref #271216
2018-10-25 22:13:19 [DEBUG   ] summary = ERROR
2018-10-25 22:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271216  13 58416 79999873 A  ERRORERROR'
2018-10-25 22:13:20 [DEBUG   ] Got command RPT from MCS: ref #271218
2018-10-25 22:13:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271218  84 58416 80000065 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:13:20 [DEBUG   ] Got command RPT from MCS: ref #271219
2018-10-25 22:13:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271219  12 58416 80000269 A  ERRORB–™š'
2018-10-25 22:13:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:13:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:13:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:13:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:13:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:13:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:13:27 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-25 22:13:44 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-25 22:14:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:14:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:14:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:14:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:14:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:14:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:14:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:14:27 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-10-25 22:14:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:15:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:15:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:15:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:15:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:15:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:15:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:15:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:15:27 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-25 22:15:37 [DEBUG   ] Got command RPT from MCS: ref #271228
2018-10-25 22:15:37 [DEBUG   ] summary = ERROR
2018-10-25 22:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271228  13 58416 80137189 A  ERRORERROR'
2018-10-25 22:15:37 [DEBUG   ] Got command RPT from MCS: ref #271229
2018-10-25 22:15:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271229  84 58416 80137190 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:15:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:16:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:16:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:16:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:16:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:16:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:16:27 [WARNING ] (13, 1, 'bot')
2018-10-25 22:16:27 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:16:27 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-25 22:16:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:17:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:17:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:17:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:17:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:17:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:17:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:17:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:17:28 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-10-25 22:17:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:18:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:18:19 [DEBUG   ] Got command RPT from MCS: ref #271249
2018-10-25 22:18:19 [DEBUG   ] summary = ERROR
2018-10-25 22:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271249  13 58416 80299553 A  ERRORERROR'
2018-10-25 22:18:19 [DEBUG   ] Got command RPT from MCS: ref #271250
2018-10-25 22:18:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271250  84 58416 80299757 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:18:19 [DEBUG   ] Got command RPT from MCS: ref #271251
2018-10-25 22:18:19 [DEBUG   ] summary = ERROR
2018-10-25 22:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271251  13 58416 80299961 A  ERRORERROR'
2018-10-25 22:18:20 [DEBUG   ] Got command RPT from MCS: ref #271252
2018-10-25 22:18:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271252  84 58416 80300153 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:18:20 [DEBUG   ] Got command RPT from MCS: ref #271253
2018-10-25 22:18:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271253  12 58416 80300357 A  ERRORB•™š'
2018-10-25 22:18:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:18:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:18:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:18:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:18:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:18:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:18:28 [DEBUG   ] Finished updating board flags in 2.256 seconds
2018-10-25 22:18:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:19:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:19:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:19:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:19:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:19:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:19:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:19:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:19:28 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-10-25 22:19:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:20:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:20:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:20:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 22:20:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:20:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:20:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:20:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:20:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:20:28 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-25 22:20:37 [DEBUG   ] Got command RPT from MCS: ref #271258
2018-10-25 22:20:37 [DEBUG   ] summary = ERROR
2018-10-25 22:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271258  13 58416 80437181 A  ERRORERROR'
2018-10-25 22:20:37 [DEBUG   ] Got command RPT from MCS: ref #271259
2018-10-25 22:20:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271259  84 58416 80437182 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:20:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 22:21:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:21:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:21:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:21:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:21:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:21:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:21:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:21:28 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-25 22:21:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:22:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:22:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:22:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:22:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:22:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:22:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:22:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:22:28 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-10-25 22:22:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:23:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:23:19 [DEBUG   ] Got command RPT from MCS: ref #271281
2018-10-25 22:23:19 [DEBUG   ] summary = ERROR
2018-10-25 22:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271281  13 58416 80599637 A  ERRORERROR'
2018-10-25 22:23:19 [DEBUG   ] Got command RPT from MCS: ref #271282
2018-10-25 22:23:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271282  84 58416 80599841 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:23:20 [DEBUG   ] Got command RPT from MCS: ref #271283
2018-10-25 22:23:20 [DEBUG   ] summary = ERROR
2018-10-25 22:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271283  13 58416 80600045 A  ERRORERROR'
2018-10-25 22:23:20 [DEBUG   ] Got command RPT from MCS: ref #271285
2018-10-25 22:23:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271285  84 58416 80600249 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:23:20 [DEBUG   ] Got command RPT from MCS: ref #271286
2018-10-25 22:23:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271286  12 58416 80600441 A  ERRORB•™š'
2018-10-25 22:23:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 22:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:23:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:23:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:23:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:23:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:23:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:23:28 [DEBUG   ] Finished updating board flags in 1.891 seconds
2018-10-25 22:23:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:24:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:24:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 22:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:24:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 22:24:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:24:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:24:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:24:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:24:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:24:28 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-25 22:24:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 22:25:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-25 22:25:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-25 22:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:25:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 22:25:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:25:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:25:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:25:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:25:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:25:28 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-10-25 22:25:37 [DEBUG   ] Got command RPT from MCS: ref #271295
2018-10-25 22:25:37 [DEBUG   ] summary = ERROR
2018-10-25 22:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271295  13 58416 80737193 A  ERRORERROR'
2018-10-25 22:25:37 [DEBUG   ] Got command RPT from MCS: ref #271296
2018-10-25 22:25:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271296  84 58416 80737194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:25:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-25 22:26:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-25 22:26:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 22:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:26:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:26:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:26:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:26:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:26:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:26:28 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-25 22:26:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 22:27:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:27:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:27:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:27:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:27:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:27:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:27:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:27:28 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-25 22:27:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 22:28:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 22:28:19 [DEBUG   ] Got command RPT from MCS: ref #271312
2018-10-25 22:28:19 [DEBUG   ] summary = ERROR
2018-10-25 22:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271312  13 58416 80899729 A  ERRORERROR'
2018-10-25 22:28:19 [DEBUG   ] Got command RPT from MCS: ref #271313
2018-10-25 22:28:19 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271313  84 58416 80899933 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:28:20 [DEBUG   ] Got command RPT from MCS: ref #271314
2018-10-25 22:28:20 [DEBUG   ] summary = ERROR
2018-10-25 22:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271314  13 58416 80900125 A  ERRORERROR'
2018-10-25 22:28:20 [DEBUG   ] Got command RPT from MCS: ref #271315
2018-10-25 22:28:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271315  84 58416 80900329 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:28:20 [DEBUG   ] Got command RPT from MCS: ref #271316
2018-10-25 22:28:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271316  12 58416 80900533 A  ERRORB•™š'
2018-10-25 22:28:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:28:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:28:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:28:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:28:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:28:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:28:28 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-25 22:28:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:29:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 22:29:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 22:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:29:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:29:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:29:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:29:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:29:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:29:28 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-25 22:29:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:30:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:30:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:30:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:30:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:30:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:30:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:30:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:30:28 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-10-25 22:30:37 [DEBUG   ] Got command RPT from MCS: ref #271321
2018-10-25 22:30:37 [DEBUG   ] summary = ERROR
2018-10-25 22:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271321  13 58416 81037193 A  ERRORERROR'
2018-10-25 22:30:37 [DEBUG   ] Got command RPT from MCS: ref #271322
2018-10-25 22:30:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271322  84 58416 81037194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:30:45 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-25 22:31:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:31:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:31:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:31:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:31:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:31:28 [WARNING ] (13, 1, 'bot')
2018-10-25 22:31:28 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:31:28 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-25 22:31:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:32:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 22:32:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:32:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:32:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:32:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:32:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:32:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:32:29 [DEBUG   ] Finished updating board flags in 2.276 seconds
2018-10-25 22:32:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:33:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:33:19 [DEBUG   ] Got command RPT from MCS: ref #271344
2018-10-25 22:33:19 [DEBUG   ] summary = ERROR
2018-10-25 22:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271344  13 58416 81199813 A  ERRORERROR'
2018-10-25 22:33:20 [DEBUG   ] Got command RPT from MCS: ref #271345
2018-10-25 22:33:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271345  84 58416 81200017 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:33:20 [DEBUG   ] Got command RPT from MCS: ref #271346
2018-10-25 22:33:20 [DEBUG   ] summary = ERROR
2018-10-25 22:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271346  13 58416 81200221 A  ERRORERROR'
2018-10-25 22:33:20 [DEBUG   ] Got command RPT from MCS: ref #271348
2018-10-25 22:33:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271348  84 58416 81200413 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:33:20 [DEBUG   ] Got command RPT from MCS: ref #271349
2018-10-25 22:33:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271349  12 58416 81200617 A  ERRORB•™š'
2018-10-25 22:33:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 22:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:33:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:33:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:33:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:33:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:33:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:33:29 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-10-25 22:33:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:34:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:34:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:34:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:34:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:34:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:34:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:34:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:34:29 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-25 22:34:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 22:35:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:35:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:35:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:35:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:35:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:35:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:35:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:35:29 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-10-25 22:35:37 [DEBUG   ] Got command RPT from MCS: ref #271358
2018-10-25 22:35:37 [DEBUG   ] summary = ERROR
2018-10-25 22:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271358  13 58416 81337193 A  ERRORERROR'
2018-10-25 22:35:37 [DEBUG   ] Got command RPT from MCS: ref #271359
2018-10-25 22:35:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271359  84 58416 81337194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:35:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:36:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 22:36:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:36:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:36:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:36:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:36:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:36:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:36:29 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-25 22:36:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-25 22:37:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:37:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-25 22:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:37:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:37:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:37:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:37:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:37:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:37:29 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-25 22:37:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:38:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 22:38:19 [DEBUG   ] Got command RPT from MCS: ref #271379
2018-10-25 22:38:19 [DEBUG   ] summary = ERROR
2018-10-25 22:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271379  13 58416 81499901 A  ERRORERROR'
2018-10-25 22:38:20 [DEBUG   ] Got command RPT from MCS: ref #271380
2018-10-25 22:38:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271380  84 58416 81500105 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:38:20 [DEBUG   ] Got command RPT from MCS: ref #271381
2018-10-25 22:38:20 [DEBUG   ] summary = ERROR
2018-10-25 22:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271381  13 58416 81500297 A  ERRORERROR'
2018-10-25 22:38:20 [DEBUG   ] Got command RPT from MCS: ref #271382
2018-10-25 22:38:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271382  84 58416 81500501 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:38:20 [DEBUG   ] Got command RPT from MCS: ref #271383
2018-10-25 22:38:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271383  12 58416 81500705 A  ERRORB”™š'
2018-10-25 22:38:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 22:38:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:38:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:38:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:38:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:38:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:38:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:38:29 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-25 22:38:45 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-25 22:39:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-25 22:39:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 22:39:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:39:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:39:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:39:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:39:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:39:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:39:29 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-25 22:39:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 22:40:06 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-10-25 22:40:26 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-25 22:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:40:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:40:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:40:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:40:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:40:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:40:29 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-25 22:40:37 [DEBUG   ] Got command RPT from MCS: ref #271388
2018-10-25 22:40:37 [DEBUG   ] summary = ERROR
2018-10-25 22:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271388  13 58416 81637193 A  ERRORERROR'
2018-10-25 22:40:37 [DEBUG   ] Got command RPT from MCS: ref #271389
2018-10-25 22:40:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271389  84 58416 81637194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:40:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 22:41:07 [DEBUG   ] Finished updating ant stats in 1.377 seconds
2018-10-25 22:41:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 22:41:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:41:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:41:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:41:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:41:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:41:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:41:29 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-25 22:41:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:42:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 22:42:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:42:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:42:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:42:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:42:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:42:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:42:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:42:29 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-10-25 22:42:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:43:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:43:19 [DEBUG   ] Got command RPT from MCS: ref #271407
2018-10-25 22:43:19 [DEBUG   ] summary = ERROR
2018-10-25 22:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271407  13 58416 81799985 A  ERRORERROR'
2018-10-25 22:43:20 [DEBUG   ] Got command RPT from MCS: ref #271408
2018-10-25 22:43:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271408  84 58416 81800189 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:43:20 [DEBUG   ] Got command RPT from MCS: ref #271409
2018-10-25 22:43:20 [DEBUG   ] summary = ERROR
2018-10-25 22:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271409  13 58416 81800381 A  ERRORERROR'
2018-10-25 22:43:20 [DEBUG   ] Got command RPT from MCS: ref #271411
2018-10-25 22:43:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271411  84 58416 81800585 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:43:20 [DEBUG   ] Got command RPT from MCS: ref #271412
2018-10-25 22:43:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271412  12 58416 81800789 A  ERRORB”™š'
2018-10-25 22:43:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:43:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:43:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:43:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:43:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:43:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:43:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:43:29 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-10-25 22:43:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:44:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:44:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:44:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:44:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:44:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:44:29 [WARNING ] (13, 1, 'bot')
2018-10-25 22:44:29 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:44:29 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-10-25 22:44:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:45:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:45:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 22:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:45:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:45:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:45:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:45:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:45:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:45:30 [DEBUG   ] Finished updating board flags in 2.309 seconds
2018-10-25 22:45:37 [DEBUG   ] Got command RPT from MCS: ref #271421
2018-10-25 22:45:37 [DEBUG   ] summary = ERROR
2018-10-25 22:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271421  13 58416 81937189 A  ERRORERROR'
2018-10-25 22:45:37 [DEBUG   ] Got command RPT from MCS: ref #271422
2018-10-25 22:45:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271422  84 58416 81937190 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:45:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:46:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:46:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:46:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:46:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:46:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:46:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:46:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:46:30 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-10-25 22:46:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:47:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:47:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:47:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:47:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:47:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:47:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:47:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:47:30 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-25 22:47:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:48:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:48:20 [DEBUG   ] Got command RPT from MCS: ref #271442
2018-10-25 22:48:20 [DEBUG   ] summary = ERROR
2018-10-25 22:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271442  13 58416 82100073 A  ERRORERROR'
2018-10-25 22:48:20 [DEBUG   ] Got command RPT from MCS: ref #271443
2018-10-25 22:48:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271443  84 58416 82100277 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:48:20 [DEBUG   ] Got command RPT from MCS: ref #271444
2018-10-25 22:48:20 [DEBUG   ] summary = ERROR
2018-10-25 22:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271444  13 58416 82100469 A  ERRORERROR'
2018-10-25 22:48:20 [DEBUG   ] Got command RPT from MCS: ref #271445
2018-10-25 22:48:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271445  84 58416 82100673 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:48:20 [DEBUG   ] Got command RPT from MCS: ref #271446
2018-10-25 22:48:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271446  12 58416 82100877 A  ERRORB”™š'
2018-10-25 22:48:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:48:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:48:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:48:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:48:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:48:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:48:30 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-25 22:48:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 22:49:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 22:49:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:49:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:49:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:49:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:49:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:49:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:49:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:49:30 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-25 22:49:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:50:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:50:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:50:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:50:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:50:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:50:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:50:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:50:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:50:30 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-10-25 22:50:37 [DEBUG   ] Got command RPT from MCS: ref #271451
2018-10-25 22:50:37 [DEBUG   ] summary = ERROR
2018-10-25 22:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271451  13 58416 82237197 A  ERRORERROR'
2018-10-25 22:50:37 [DEBUG   ] Got command RPT from MCS: ref #271452
2018-10-25 22:50:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271452  84 58416 82237198 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:50:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 22:51:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:51:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:51:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:51:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:51:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:51:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:51:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:51:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:51:30 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-25 22:51:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:52:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:52:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:52:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:52:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:52:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:52:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:52:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:52:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:52:30 [DEBUG   ] Finished updating board flags in 1.673 seconds
2018-10-25 22:52:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:53:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 22:53:20 [DEBUG   ] Got command RPT from MCS: ref #271474
2018-10-25 22:53:20 [DEBUG   ] summary = ERROR
2018-10-25 22:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271474  13 58416 82400153 A  ERRORERROR'
2018-10-25 22:53:20 [DEBUG   ] Got command RPT from MCS: ref #271475
2018-10-25 22:53:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271475  84 58416 82400357 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:53:20 [DEBUG   ] Got command RPT from MCS: ref #271476
2018-10-25 22:53:20 [DEBUG   ] summary = ERROR
2018-10-25 22:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271476  13 58416 82400561 A  ERRORERROR'
2018-10-25 22:53:20 [DEBUG   ] Got command RPT from MCS: ref #271478
2018-10-25 22:53:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271478  84 58416 82400753 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:53:20 [DEBUG   ] Got command RPT from MCS: ref #271479
2018-10-25 22:53:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271479  12 58416 82400957 A  ERRORB”™š'
2018-10-25 22:53:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:53:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:53:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 22:53:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:53:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:53:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:53:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:53:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:53:30 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-25 22:53:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:54:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 22:54:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 22:54:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:54:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:54:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:54:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:54:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:54:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:54:30 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-25 22:54:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 22:55:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 22:55:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 22:55:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:55:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:55:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:55:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:55:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:55:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:55:30 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-25 22:55:37 [DEBUG   ] Got command RPT from MCS: ref #271488
2018-10-25 22:55:37 [DEBUG   ] summary = ERROR
2018-10-25 22:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271488  13 58416 82537189 A  ERRORERROR'
2018-10-25 22:55:37 [DEBUG   ] Got command RPT from MCS: ref #271489
2018-10-25 22:55:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271489  84 58416 82537190 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:55:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:56:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:56:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:56:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 22:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:56:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:56:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:56:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:56:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:56:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:56:30 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-25 22:56:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 22:57:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 22:57:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 22:57:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 22:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:57:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:57:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:57:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:57:30 [WARNING ] (13, 1, 'bot')
2018-10-25 22:57:30 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:57:30 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-10-25 22:57:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 22:58:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:58:20 [DEBUG   ] Got command RPT from MCS: ref #271505
2018-10-25 22:58:20 [DEBUG   ] summary = ERROR
2018-10-25 22:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271505  13 58416 82700249 A  ERRORERROR'
2018-10-25 22:58:20 [DEBUG   ] Got command RPT from MCS: ref #271506
2018-10-25 22:58:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271506  84 58416 82700441 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:58:20 [DEBUG   ] Got command RPT from MCS: ref #271507
2018-10-25 22:58:20 [DEBUG   ] summary = ERROR
2018-10-25 22:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271507  13 58416 82700645 A  ERRORERROR'
2018-10-25 22:58:20 [DEBUG   ] Got command RPT from MCS: ref #271508
2018-10-25 22:58:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 22:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271508  84 58416 82700849 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 22:58:21 [DEBUG   ] Got command RPT from MCS: ref #271509
2018-10-25 22:58:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 22:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271509  12 58416 82701053 A  ERRORB—™š'
2018-10-25 22:58:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 22:58:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 22:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:58:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:58:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:58:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:58:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:58:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:58:31 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-10-25 22:58:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 22:59:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:59:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 22:59:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-25 22:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 22:59:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:59:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:59:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:59:31 [WARNING ] (13, 1, 'bot')
2018-10-25 22:59:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 22:59:31 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-10-25 22:59:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-25 23:00:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 23:00:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 23:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:00:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:00:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:00:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:00:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:00:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:00:31 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-10-25 23:00:37 [DEBUG   ] Got command RPT from MCS: ref #271514
2018-10-25 23:00:37 [DEBUG   ] summary = ERROR
2018-10-25 23:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271514  13 58416 82837193 A  ERRORERROR'
2018-10-25 23:00:37 [DEBUG   ] Got command RPT from MCS: ref #271515
2018-10-25 23:00:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271515  84 58416 82837194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:00:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 23:01:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 23:01:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-25 23:01:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:01:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:01:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:01:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:01:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:01:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:01:31 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-25 23:01:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-25 23:02:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-25 23:02:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-25 23:02:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:02:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:02:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:02:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:02:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:02:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:02:31 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-25 23:02:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-25 23:03:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:03:20 [DEBUG   ] Got command RPT from MCS: ref #271537
2018-10-25 23:03:20 [DEBUG   ] summary = ERROR
2018-10-25 23:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271537  13 58416 83000325 A  ERRORERROR'
2018-10-25 23:03:20 [DEBUG   ] Got command RPT from MCS: ref #271538
2018-10-25 23:03:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271538  84 58416 83000529 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:03:20 [DEBUG   ] Got command RPT from MCS: ref #271539
2018-10-25 23:03:20 [DEBUG   ] summary = ERROR
2018-10-25 23:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271539  13 58416 83000733 A  ERRORERROR'
2018-10-25 23:03:20 [DEBUG   ] Got command RPT from MCS: ref #271541
2018-10-25 23:03:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271541  84 58416 83000937 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:03:21 [DEBUG   ] Got command RPT from MCS: ref #271542
2018-10-25 23:03:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271542  12 58416 83001129 A  ERRORB—™š'
2018-10-25 23:03:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:03:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:03:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 23:03:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:03:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:03:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:03:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:03:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:03:31 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-25 23:03:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 23:04:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 23:04:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 23:04:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:04:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:04:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:04:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:04:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:04:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:04:31 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-25 23:04:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:05:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-25 23:05:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:05:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:05:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:05:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:05:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:05:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:05:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:05:31 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-25 23:05:37 [DEBUG   ] Got command RPT from MCS: ref #271551
2018-10-25 23:05:37 [DEBUG   ] summary = ERROR
2018-10-25 23:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271551  13 58416 83137194 A  ERRORERROR'
2018-10-25 23:05:37 [DEBUG   ] Got command RPT from MCS: ref #271552
2018-10-25 23:05:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271552  84 58416 83137194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:05:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 23:06:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:06:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-25 23:06:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:06:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:06:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:06:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:06:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:06:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:06:31 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-25 23:06:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-25 23:07:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 23:07:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:07:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:07:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:07:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:07:31 [WARNING ] (13, 1, 'bot')
2018-10-25 23:07:31 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:07:31 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-10-25 23:07:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 23:08:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:08:20 [DEBUG   ] Got command RPT from MCS: ref #271572
2018-10-25 23:08:20 [DEBUG   ] summary = ERROR
2018-10-25 23:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271572  13 58416 83300413 A  ERRORERROR'
2018-10-25 23:08:20 [DEBUG   ] Got command RPT from MCS: ref #271573
2018-10-25 23:08:20 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271573  84 58416 83300617 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:08:20 [DEBUG   ] Got command RPT from MCS: ref #271574
2018-10-25 23:08:20 [DEBUG   ] summary = ERROR
2018-10-25 23:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271574  13 58416 83300821 A  ERRORERROR'
2018-10-25 23:08:21 [DEBUG   ] Got command RPT from MCS: ref #271575
2018-10-25 23:08:21 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271575  84 58416 83301013 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:08:21 [DEBUG   ] Got command RPT from MCS: ref #271576
2018-10-25 23:08:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271576  12 58416 83301217 A  ERRORB–™š'
2018-10-25 23:08:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 23:08:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:08:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:08:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:08:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:08:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:08:32 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:08:32 [DEBUG   ] Finished updating board flags in 2.239 seconds
2018-10-25 23:08:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:09:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-25 23:09:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:09:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:09:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:09:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:09:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:09:32 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:09:32 [DEBUG   ] Finished updating board flags in 2.127 seconds
2018-10-25 23:09:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 23:10:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-25 23:10:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 23:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:10:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:10:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:10:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:10:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:10:32 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:10:32 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-25 23:10:37 [DEBUG   ] Got command RPT from MCS: ref #271580
2018-10-25 23:10:37 [DEBUG   ] summary = ERROR
2018-10-25 23:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271580  13 58416 83437193 A  ERRORERROR'
2018-10-25 23:10:37 [DEBUG   ] Got command RPT from MCS: ref #271581
2018-10-25 23:10:37 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271581  84 58416 83437194 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:10:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:11:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 23:11:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 23:11:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:11:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:11:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:11:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:11:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:11:32 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:11:32 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-25 23:11:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-25 23:12:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:12:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-25 23:12:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:12:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:12:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:12:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:12:32 [WARNING ] (13, 1, 'bot')
2018-10-25 23:12:32 [CRITICAL] MGT underflow detected on beam(s) 1, 3
2018-10-25 23:12:32 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-25 23:12:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:13:00 [DEBUG   ] Got command RPT from MCS: ref #271600
2018-10-25 23:13:00 [DEBUG   ] summary = ERROR
2018-10-25 23:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271600  13 58416 83580389 A  ERRORERROR'
2018-10-25 23:13:00 [DEBUG   ] Got command RPT from MCS: ref #271601
2018-10-25 23:13:00 [DEBUG   ] info = T_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271601  84 58416 83580390 A  ERRORT_NOM1 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:13:05 [DEBUG   ] Got command INI from MCS: ref #271602
2018-10-25 23:13:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-25 23:13:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   271602   8 58416 83585402 ABOOTING'
2018-10-25 23:13:08 [DEBUG   ] Finished updating ant stats in 0.835 seconds
2018-10-25 23:13:20 [DEBUG   ] Got command RPT from MCS: ref #271603
2018-10-25 23:13:20 [DEBUG   ] summary = BOOTING
2018-10-25 23:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271603  15 58416 83600493 ABOOTINGBOOTING'
2018-10-25 23:13:29 [INFO    ] -------------------
2018-10-25 23:13:29 [INFO    ]  LWA board status
2018-10-25 23:13:29 [INFO    ] -------------------
2018-10-25 23:13:29 [INFO    ] DP 1: 2 lwa27
2018-10-25 23:13:29 [INFO    ] DP 1: 3 lwa24
2018-10-25 23:13:29 [INFO    ] DP 1: 4 lwa23
2018-10-25 23:13:29 [INFO    ] DP 1: 5 lwa18
2018-10-25 23:13:29 [INFO    ] DP 1: 6 lwa10
2018-10-25 23:13:29 [INFO    ] DP 1: 7 lwa32
2018-10-25 23:13:29 [INFO    ] DP 1: 8 lwa11
2018-10-25 23:13:29 [INFO    ] DP 1: 9 lwa30
2018-10-25 23:13:29 [INFO    ] DP 1: 10 lwa12
2018-10-25 23:13:29 [INFO    ] DP 1: 11 lwa8
2018-10-25 23:13:29 [INFO    ] DP 1: 12 lwa13
2018-10-25 23:13:29 [INFO    ] DP 1: 13 lwa26
2018-10-25 23:13:29 [INFO    ] DP 1: 14 lwa14
2018-10-25 23:13:29 [INFO    ] DP 1: 16 lwa22
2018-10-25 23:13:29 [INFO    ] DP 1: 17 lwa20
2018-10-25 23:13:29 [INFO    ] DP 1: 18 lwa1
2018-10-25 23:13:29 [INFO    ] DP 1: 19 lwa5
2018-10-25 23:13:29 [INFO    ] DP 1: 20 lwa25
2018-10-25 23:13:29 [INFO    ] DP 1: 21 lwa35
2018-10-25 23:13:29 [INFO    ] DP 1: 22 lwa19
2018-10-25 23:13:29 [INFO    ] DP 1: 23 lwa21
2018-10-25 23:13:29 [INFO    ] DP 1: 24 lwa6
2018-10-25 23:13:29 [INFO    ] DP 1: 25 lwa7
2018-10-25 23:13:29 [INFO    ] DP 1: 26 lwa33
2018-10-25 23:13:29 [INFO    ] DP 1: 27 lwa15
2018-10-25 23:13:29 [INFO    ] DP 1: 28 lwa28
2018-10-25 23:13:29 [INFO    ] DP 2: 1 lwa16
2018-10-25 23:13:29 [INFO    ] DP 2: 15 lwa34
2018-10-25 23:13:29 [INFO    ] Total of 28 boards
2018-10-25 23:13:29 [INFO    ] Total of 260 stands
2018-10-25 23:13:29 [INFO    ] -------------------
2018-10-25 23:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13050
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13051
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13052
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13053
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13054
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13055
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13056
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13057
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13058
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13059
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13060
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13061
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13062
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13063
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13064
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13065
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13066
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13067
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13068
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13069
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13070
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13071
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13072
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13073
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13074
2018-10-25 23:13:36 [DEBUG   ] 2018-10-25 23:13:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13075
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13050 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13051 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13052 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13053 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13054 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13055 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13056 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13057 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13058 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13059 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13060 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13061 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13062 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13063 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13064 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13065 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13066 exited with status 0
2018-10-25 23:13:48 [DEBUG   ] 2018-10-25 23:13:48 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13067 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13068 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13069 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13070 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13071 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13072 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13073 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13074 exited with status 0
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13075 exited with status 0
2018-10-25 23:13:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] spawn_process: at 2018-10-25 23:13:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13102
2018-10-25 23:13:49 [DEBUG   ] 2018-10-25 23:13:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13103
2018-10-25 23:13:54 [DEBUG   ] 2018-10-25 23:13:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13102 exited with status 0
2018-10-25 23:13:54 [DEBUG   ] 2018-10-25 23:13:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13103 exited with status 0
2018-10-25 23:13:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-25 23:13:54 [DEBUG   ] spawn_process: at 2018-10-25 23:13:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-25 23:13:54 [DEBUG   ] spawn_process: at 2018-10-25 23:13:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-25 23:13:54 [INFO    ] Setting Beam 1 xbars
2018-10-25 23:13:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-25 23:13:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-25 23:13:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-25 23:13:54 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-25 23:13:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-25 23:13:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-25 23:13:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-25 23:13:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-25 23:13:58 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-25 23:13:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-25 23:14:00 [INFO    ] Setting Beam 2 xbars
2018-10-25 23:14:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-25 23:14:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-25 23:14:01 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-25 23:14:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-25 23:14:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-25 23:14:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-25 23:14:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-25 23:14:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-25 23:14:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-25 23:14:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-25 23:14:05 [INFO    ] Setting Beam 3 xbars
2018-10-25 23:14:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-25 23:14:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-25 23:14:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-25 23:14:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-25 23:14:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-25 23:14:05 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-25 23:14:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-25 23:14:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-25 23:14:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-25 23:14:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-25 23:14:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-25 23:14:10 [INFO    ] Setting Beam 4 xbars
2018-10-25 23:14:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-25 23:14:10 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-25 23:14:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-25 23:14:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-25 23:14:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-25 23:14:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-25 23:14:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-25 23:14:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-25 23:14:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-25 23:14:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-25 23:14:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-25 23:14:16 [INFO    ] All xbars set
2018-10-25 23:14:16 [INFO    ] Setting adder chain routing for all beams
2018-10-25 23:14:21 [INFO    ] Setting beam ids
2018-10-25 23:14:31 [INFO    ] Starting beam delay calibration
2018-10-25 23:14:43 [INFO    ] Beam 1 latency is 5728
2018-10-25 23:14:43 [INFO    ] Beam 2 latency is 5738
2018-10-25 23:14:43 [INFO    ] Beam 3 latency is 5734
2018-10-25 23:14:43 [INFO    ] Beam 4 latency is 5733
2018-10-25 23:14:43 [INFO    ] Stop calibration
2018-10-25 23:14:51 [INFO    ] Beam delay calibration successful
2018-10-25 23:14:51 [INFO    ] Calibration passed
2018-10-25 23:14:51 [DEBUG   ] spawn_process: at 2018-10-25 23:14:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-25 23:14:51 [DEBUG   ] spawn_process: at 2018-10-25 23:14:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-25 23:14:51 [DEBUG   ] spawn_process: at 2018-10-25 23:14:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-25 23:14:51 [DEBUG   ] spawn_process: at 2018-10-25 23:14:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-25 23:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-25 23:14:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-25 23:14:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 292 ms (1540509292.294 s) with PID 14681 and time 1540509293
2018-10-25 23:14:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-25 23:14:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 382 ms (1540509292.384 s) with PID 14684 and time 1540509293
2018-10-25 23:14:53 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-10-25 23:14:53 [INFO    ] Started antennas statistics background thread
2018-10-25 23:14:53 [INFO    ] Started board flags background thread
2018-10-25 23:14:53 [INFO    ] Started BAM background thread
2018-10-25 23:14:53 [INFO    ] Finished the INI process (ref. #271602) in 108.104 s
2018-10-25 23:14:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:14:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:14:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:14:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:14:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:14:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:14:54 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-10-25 23:15:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:15:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:15:37 [DEBUG   ] Got command RPT from MCS: ref #271613
2018-10-25 23:15:37 [DEBUG   ] summary = ERROR
2018-10-25 23:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271613  13 58416 83737197 A  ERRORERROR'
2018-10-25 23:15:37 [DEBUG   ] Got command RPT from MCS: ref #271614
2018-10-25 23:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271614  77 58416 83737198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:15:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:15:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:15:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:15:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:15:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:15:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:15:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:15:54 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-10-25 23:16:05 [DEBUG   ] Got command RPT from MCS: ref #271630
2018-10-25 23:16:05 [DEBUG   ] summary = ERROR
2018-10-25 23:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271630  13 58416 83765401 A  ERRORERROR'
2018-10-25 23:16:05 [DEBUG   ] Got command RPT from MCS: ref #271631
2018-10-25 23:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271631  77 58416 83765402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:16:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 23:16:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 23:16:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:16:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:16:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:16:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:16:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:16:54 [DEBUG   ] Finished updating board flags in 1.273 seconds
2018-10-25 23:17:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:17:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:17:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:17:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:17:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:17:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:17:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:17:54 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-10-25 23:18:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:18:20 [DEBUG   ] Got command RPT from MCS: ref #271636
2018-10-25 23:18:20 [DEBUG   ] summary = ERROR
2018-10-25 23:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271636  13 58416 83900577 A  ERRORERROR'
2018-10-25 23:18:20 [DEBUG   ] Got command RPT from MCS: ref #271637
2018-10-25 23:18:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271637  77 58416 83900781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:18:20 [DEBUG   ] Got command RPT from MCS: ref #271638
2018-10-25 23:18:20 [DEBUG   ] summary = ERROR
2018-10-25 23:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271638  13 58416 83900985 A  ERRORERROR'
2018-10-25 23:18:21 [DEBUG   ] Got command RPT from MCS: ref #271639
2018-10-25 23:18:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271639  77 58416 83901189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:18:21 [DEBUG   ] Got command RPT from MCS: ref #271640
2018-10-25 23:18:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271640  12 58416 83901381 A  ERRORB•™š'
2018-10-25 23:18:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:18:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-25 23:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:18:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:18:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:18:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:18:54 [WARNING ] (13, 1, 'bot')
2018-10-25 23:18:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:18:54 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-10-25 23:19:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:19:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:19:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 23:19:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:19:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:19:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:19:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:19:55 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-25 23:20:13 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-10-25 23:20:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:20:37 [DEBUG   ] Got command RPT from MCS: ref #271645
2018-10-25 23:20:37 [DEBUG   ] summary = ERROR
2018-10-25 23:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271645  13 58416 84037197 A  ERRORERROR'
2018-10-25 23:20:37 [DEBUG   ] Got command RPT from MCS: ref #271646
2018-10-25 23:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271646  77 58416 84037198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:20:54 [DEBUG   ] Finished updating ant stats in 1.237 seconds
2018-10-25 23:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:20:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:20:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:20:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:20:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:20:55 [DEBUG   ] Finished updating board flags in 1.345 seconds
2018-10-25 23:21:14 [DEBUG   ] Finished updating ant stats in 1.166 seconds
2018-10-25 23:21:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:21:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:21:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:21:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:21:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:21:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:21:55 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-10-25 23:22:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:22:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:22:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-25 23:22:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:22:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:22:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:22:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:22:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:22:55 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-10-25 23:23:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:23:20 [DEBUG   ] Got command RPT from MCS: ref #271668
2018-10-25 23:23:20 [DEBUG   ] summary = ERROR
2018-10-25 23:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271668  13 58416 84200665 A  ERRORERROR'
2018-10-25 23:23:20 [DEBUG   ] Got command RPT from MCS: ref #271669
2018-10-25 23:23:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271669  77 58416 84200869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:23:21 [DEBUG   ] Got command RPT from MCS: ref #271670
2018-10-25 23:23:21 [DEBUG   ] summary = ERROR
2018-10-25 23:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271670  13 58416 84201073 A  ERRORERROR'
2018-10-25 23:23:21 [DEBUG   ] Got command RPT from MCS: ref #271672
2018-10-25 23:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271672  77 58416 84201265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:23:21 [DEBUG   ] Got command RPT from MCS: ref #271674
2018-10-25 23:23:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271674  12 58416 84201469 A  ERRORB•™š'
2018-10-25 23:23:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:23:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:23:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:23:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:23:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:23:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:23:55 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-10-25 23:24:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:24:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:24:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-25 23:24:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:24:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:24:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:24:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:24:56 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-10-25 23:25:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:25:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:25:37 [DEBUG   ] Got command RPT from MCS: ref #271680
2018-10-25 23:25:37 [DEBUG   ] summary = ERROR
2018-10-25 23:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271680  13 58416 84337197 A  ERRORERROR'
2018-10-25 23:25:37 [DEBUG   ] Got command RPT from MCS: ref #271681
2018-10-25 23:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271681  77 58416 84337198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:25:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:25:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:25:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:25:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:25:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:25:56 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-25 23:26:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:26:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:26:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:26:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:26:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:26:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:26:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:26:55 [DEBUG   ] Finished updating board flags in 1.266 seconds
2018-10-25 23:27:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:27:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:27:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:27:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:27:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:27:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:27:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:27:55 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-10-25 23:28:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:28:20 [DEBUG   ] Got command RPT from MCS: ref #271699
2018-10-25 23:28:20 [DEBUG   ] summary = ERROR
2018-10-25 23:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271699  13 58416 84500753 A  ERRORERROR'
2018-10-25 23:28:20 [DEBUG   ] Got command RPT from MCS: ref #271700
2018-10-25 23:28:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271700  77 58416 84500957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:28:21 [DEBUG   ] Got command RPT from MCS: ref #271701
2018-10-25 23:28:21 [DEBUG   ] summary = ERROR
2018-10-25 23:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271701  13 58416 84501149 A  ERRORERROR'
2018-10-25 23:28:21 [DEBUG   ] Got command RPT from MCS: ref #271702
2018-10-25 23:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271702  77 58416 84501353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:28:21 [DEBUG   ] Got command RPT from MCS: ref #271703
2018-10-25 23:28:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271703  12 58416 84501557 A  ERRORB•™š'
2018-10-25 23:28:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:28:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:28:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:28:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:28:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:28:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:28:55 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-25 23:29:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:29:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:29:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:29:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:29:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:29:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:29:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:29:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:29:55 [DEBUG   ] Finished updating board flags in 1.170 seconds
2018-10-25 23:30:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-25 23:30:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:30:37 [DEBUG   ] Got command RPT from MCS: ref #271708
2018-10-25 23:30:37 [DEBUG   ] summary = ERROR
2018-10-25 23:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271708  13 58416 84637197 A  ERRORERROR'
2018-10-25 23:30:37 [DEBUG   ] Got command RPT from MCS: ref #271709
2018-10-25 23:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271709  77 58416 84637198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:30:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:30:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:30:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:30:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:30:55 [WARNING ] (13, 1, 'bot')
2018-10-25 23:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:30:55 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-25 23:31:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:31:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:31:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:31:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:31:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:31:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:31:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:31:56 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-10-25 23:32:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-25 23:32:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-25 23:32:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-25 23:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:32:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:32:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:32:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:32:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:32:56 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-10-25 23:33:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-25 23:33:20 [DEBUG   ] Got command RPT from MCS: ref #271731
2018-10-25 23:33:20 [DEBUG   ] summary = ERROR
2018-10-25 23:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271731  13 58416 84800841 A  ERRORERROR'
2018-10-25 23:33:21 [DEBUG   ] Got command RPT from MCS: ref #271732
2018-10-25 23:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271732  77 58416 84801033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:33:21 [DEBUG   ] Got command RPT from MCS: ref #271733
2018-10-25 23:33:21 [DEBUG   ] summary = ERROR
2018-10-25 23:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271733  13 58416 84801237 A  ERRORERROR'
2018-10-25 23:33:21 [DEBUG   ] Got command RPT from MCS: ref #271735
2018-10-25 23:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271735  77 58416 84801441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:33:21 [DEBUG   ] Got command RPT from MCS: ref #271737
2018-10-25 23:33:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271737  12 58416 84801645 A  ERRORB•™š'
2018-10-25 23:33:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:33:53 [DEBUG   ] Got command BAM from MCS: ref #271746
2018-10-25 23:33:53 [INFO    ] Finished processing BAM request
2018-10-25 23:33:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271746   8 58416 84833033 A  ERROR'
2018-10-25 23:33:53 [DEBUG   ] Got command BAM from MCS: ref #271745
2018-10-25 23:33:53 [INFO    ] Finished processing BAM request
2018-10-25 23:33:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271745   8 58416 84833037 A  ERROR'
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:33:53 [DEBUG   ] Got command DRX from MCS: ref #271748
2018-10-25 23:33:53 [INFO    ] sending drx command to lwa16
2018-10-25 23:33:53 [DEBUG   ] run_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 68000000.0 6 9 90']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:33:53 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   271748   8 58416 84833918 A  ERROR'
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:33:53 [DEBUG   ] Got command DRX from MCS: ref #271747
2018-10-25 23:33:53 [INFO    ] sending drx command to lwa34
2018-10-25 23:33:53 [DEBUG   ] run_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 68000000.0 6 9 90']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:33:53 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-25 23:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   271747   8 58416 84833922 A  ERROR'
2018-10-25 23:33:53 [DEBUG   ] Got command DRX from MCS: ref #271750
2018-10-25 23:33:53 [INFO    ] sending drx command to lwa16
2018-10-25 23:33:53 [DEBUG   ] run_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 78000000.0 6 9 90']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:33:53 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-25 23:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   271750   8 58416 84833925 A  ERROR'
2018-10-25 23:33:53 [DEBUG   ] Got command DRX from MCS: ref #271749
2018-10-25 23:33:53 [INFO    ] sending drx command to lwa34
2018-10-25 23:33:53 [DEBUG   ] run_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 78000000.0 6 9 90']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:33:53 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-25 23:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   271749   8 58416 84833930 A  ERROR'
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:33:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:33:53 [DEBUG   ] spawn_process: at 2018-10-25 23:33:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:33:53 [INFO    ] Finished starting DRX
2018-10-25 23:33:53 [INFO    ] Finished starting DRX
2018-10-25 23:33:53 [INFO    ] Finished starting DRX
2018-10-25 23:33:53 [INFO    ] Finished starting DRX
2018-10-25 23:33:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:33:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:33:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:33:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:33:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:33:56 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-10-25 23:34:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:34:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:34:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:34:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:34:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:34:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:34:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:34:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:34:56 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-10-25 23:35:02 [DEBUG   ] Got command BAM from MCS: ref #271757
2018-10-25 23:35:02 [INFO    ] Finished processing BAM request
2018-10-25 23:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271757   8 58416 84902025 A  ERROR'
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:35:02 [DEBUG   ] spawn_process: at 2018-10-25 23:35:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:35:09 [DEBUG   ] Got command BAM from MCS: ref #271758
2018-10-25 23:35:09 [INFO    ] Finished processing BAM request
2018-10-25 23:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271758   8 58416 84909029 A  ERROR'
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:35:09 [DEBUG   ] spawn_process: at 2018-10-25 23:35:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:35:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:35:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:35:37 [DEBUG   ] Got command RPT from MCS: ref #271759
2018-10-25 23:35:37 [DEBUG   ] summary = ERROR
2018-10-25 23:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271759  13 58416 84937205 A  ERRORERROR'
2018-10-25 23:35:37 [DEBUG   ] Got command RPT from MCS: ref #271760
2018-10-25 23:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271760  77 58416 84937206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:35:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:35:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:35:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:35:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:35:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:35:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:35:56 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-10-25 23:36:10 [DEBUG   ] Got command BAM from MCS: ref #271776
2018-10-25 23:36:10 [INFO    ] Finished processing BAM request
2018-10-25 23:36:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271776   8 58416 84970029 A  ERROR'
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:36:10 [DEBUG   ] spawn_process: at 2018-10-25 23:36:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:36:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:36:24 [DEBUG   ] Got command BAM from MCS: ref #271777
2018-10-25 23:36:24 [INFO    ] Finished processing BAM request
2018-10-25 23:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271777   8 58416 84984033 A  ERROR'
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:36:24 [DEBUG   ] spawn_process: at 2018-10-25 23:36:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:36:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:36:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-25 23:36:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:36:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:36:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:36:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:36:57 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-25 23:37:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:37:17 [DEBUG   ] Got command BAM from MCS: ref #271778
2018-10-25 23:37:17 [INFO    ] Finished processing BAM request
2018-10-25 23:37:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271778   8 58416 85037029 A  ERROR'
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:37:17 [DEBUG   ] spawn_process: at 2018-10-25 23:37:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:37:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:37:38 [DEBUG   ] Got command BAM from MCS: ref #271779
2018-10-25 23:37:38 [INFO    ] Finished processing BAM request
2018-10-25 23:37:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271779   8 58416 85058033 A  ERROR'
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:37:38 [DEBUG   ] spawn_process: at 2018-10-25 23:37:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:37:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 23:37:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:37:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:37:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:37:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:37:56 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-25 23:38:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:38:20 [DEBUG   ] Got command RPT from MCS: ref #271784
2018-10-25 23:38:20 [DEBUG   ] summary = ERROR
2018-10-25 23:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271784  13 58416 85100925 A  ERRORERROR'
2018-10-25 23:38:21 [DEBUG   ] Got command RPT from MCS: ref #271785
2018-10-25 23:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271785  77 58416 85101129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:38:21 [DEBUG   ] Got command RPT from MCS: ref #271786
2018-10-25 23:38:21 [DEBUG   ] summary = ERROR
2018-10-25 23:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271786  13 58416 85101321 A  ERRORERROR'
2018-10-25 23:38:21 [DEBUG   ] Got command RPT from MCS: ref #271787
2018-10-25 23:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271787  77 58416 85101525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:38:21 [DEBUG   ] Got command RPT from MCS: ref #271788
2018-10-25 23:38:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271788  12 58416 85101729 A  ERRORBžff'
2018-10-25 23:38:23 [DEBUG   ] Got command BAM from MCS: ref #271789
2018-10-25 23:38:23 [INFO    ] Finished processing BAM request
2018-10-25 23:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271789   8 58416 85103029 A  ERROR'
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:38:23 [DEBUG   ] spawn_process: at 2018-10-25 23:38:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:38:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:38:50 [DEBUG   ] Got command BAM from MCS: ref #271790
2018-10-25 23:38:50 [INFO    ] Finished processing BAM request
2018-10-25 23:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271790   8 58416 85130025 A  ERROR'
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:38:50 [DEBUG   ] spawn_process: at 2018-10-25 23:38:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:38:53 [DEBUG   ] Got command BAM from MCS: ref #271792
2018-10-25 23:38:53 [INFO    ] Finished processing BAM request
2018-10-25 23:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271792   8 58416 85133033 A  ERROR'
2018-10-25 23:38:53 [DEBUG   ] Got command BAM from MCS: ref #271791
2018-10-25 23:38:53 [INFO    ] Finished processing BAM request
2018-10-25 23:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271791   8 58416 85133037 A  ERROR'
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-25 23:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-25 23:38:53 [DEBUG   ] spawn_process: at 2018-10-25 23:38:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-25 23:38:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:38:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 23:38:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:38:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:38:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:38:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:38:56 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-25 23:39:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:39:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:39:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:39:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-25 23:39:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 23:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:39:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:39:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:39:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:39:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:39:56 [DEBUG   ] Finished updating board flags in 1.337 seconds
2018-10-25 23:40:01 [DEBUG   ] Got command BAM from MCS: ref #271795
2018-10-25 23:40:01 [INFO    ] Finished processing BAM request
2018-10-25 23:40:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271795   8 58416 85201025 A  ERROR'
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:40:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:40:01 [DEBUG   ] spawn_process: at 2018-10-25 23:40:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:40:05 [DEBUG   ] Got command BAM from MCS: ref #271796
2018-10-25 23:40:05 [INFO    ] Finished processing BAM request
2018-10-25 23:40:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271796   8 58416 85205025 A  ERROR'
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:40:05 [DEBUG   ] spawn_process: at 2018-10-25 23:40:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:40:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:40:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:40:37 [DEBUG   ] Got command RPT from MCS: ref #271797
2018-10-25 23:40:37 [DEBUG   ] summary = ERROR
2018-10-25 23:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271797  13 58416 85237205 A  ERRORERROR'
2018-10-25 23:40:37 [DEBUG   ] Got command RPT from MCS: ref #271798
2018-10-25 23:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271798  77 58416 85237206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:40:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:40:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:40:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:40:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:40:56 [WARNING ] (13, 1, 'bot')
2018-10-25 23:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:40:56 [DEBUG   ] Finished updating board flags in 1.156 seconds
2018-10-25 23:41:09 [DEBUG   ] Got command BAM from MCS: ref #271818
2018-10-25 23:41:09 [INFO    ] Finished processing BAM request
2018-10-25 23:41:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271818   8 58416 85269025 A  ERROR'
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:41:09 [DEBUG   ] spawn_process: at 2018-10-25 23:41:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:41:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:41:17 [DEBUG   ] Got command BAM from MCS: ref #271819
2018-10-25 23:41:17 [INFO    ] Finished processing BAM request
2018-10-25 23:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271819   8 58416 85277033 A  ERROR'
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:41:17 [DEBUG   ] spawn_process: at 2018-10-25 23:41:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:41:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:41:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:41:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 23:41:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:41:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:41:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:41:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:41:57 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-10-25 23:42:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:42:17 [DEBUG   ] Got command BAM from MCS: ref #271820
2018-10-25 23:42:17 [INFO    ] Finished processing BAM request
2018-10-25 23:42:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271820   8 58416 85337025 A  ERROR'
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:42:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:42:17 [DEBUG   ] spawn_process: at 2018-10-25 23:42:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:42:29 [DEBUG   ] Got command BAM from MCS: ref #271821
2018-10-25 23:42:29 [INFO    ] Finished processing BAM request
2018-10-25 23:42:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271821   8 58416 85349029 A  ERROR'
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-25 23:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-25 23:42:29 [DEBUG   ] spawn_process: at 2018-10-25 23:42:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-25 23:42:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:42:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:42:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:42:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:42:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:42:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:42:57 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-25 23:43:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:43:21 [DEBUG   ] Got command RPT from MCS: ref #271824
2018-10-25 23:43:21 [DEBUG   ] summary = ERROR
2018-10-25 23:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271824  13 58416 85401013 A  ERRORERROR'
2018-10-25 23:43:21 [DEBUG   ] Got command RPT from MCS: ref #271825
2018-10-25 23:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271825  77 58416 85401205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:43:21 [DEBUG   ] Got command RPT from MCS: ref #271826
2018-10-25 23:43:21 [DEBUG   ] summary = ERROR
2018-10-25 23:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271826  13 58416 85401409 A  ERRORERROR'
2018-10-25 23:43:21 [DEBUG   ] Got command RPT from MCS: ref #271828
2018-10-25 23:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271828  77 58416 85401613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:43:21 [DEBUG   ] Got command RPT from MCS: ref #271829
2018-10-25 23:43:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271829  12 58416 85401817 A  ERRORBŸff'
2018-10-25 23:43:25 [DEBUG   ] Got command BAM from MCS: ref #271834
2018-10-25 23:43:25 [INFO    ] Finished processing BAM request
2018-10-25 23:43:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271834   8 58416 85405025 A  ERROR'
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:43:25 [DEBUG   ] spawn_process: at 2018-10-25 23:43:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:43:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:43:41 [DEBUG   ] Got command BAM from MCS: ref #271839
2018-10-25 23:43:41 [INFO    ] Finished processing BAM request
2018-10-25 23:43:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271839   8 58416 85421025 A  ERROR'
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:43:41 [DEBUG   ] spawn_process: at 2018-10-25 23:43:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:43:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:43:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:43:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-25 23:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:43:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:43:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:43:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:43:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:43:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:43:57 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-10-25 23:44:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:44:33 [DEBUG   ] Got command BAM from MCS: ref #271840
2018-10-25 23:44:33 [INFO    ] Finished processing BAM request
2018-10-25 23:44:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271840   8 58416 85473025 A  ERROR'
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:44:33 [DEBUG   ] spawn_process: at 2018-10-25 23:44:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:44:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:44:53 [DEBUG   ] Got command BAM from MCS: ref #271841
2018-10-25 23:44:53 [INFO    ] Finished processing BAM request
2018-10-25 23:44:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271841   8 58416 85493033 A  ERROR'
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:44:53 [DEBUG   ] spawn_process: at 2018-10-25 23:44:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:44:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:44:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-25 23:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:44:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-25 23:44:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:44:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:44:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:44:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:44:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:44:57 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-10-25 23:45:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:45:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:45:37 [DEBUG   ] Got command RPT from MCS: ref #271842
2018-10-25 23:45:37 [DEBUG   ] summary = ERROR
2018-10-25 23:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271842  13 58416 85537209 A  ERRORERROR'
2018-10-25 23:45:37 [DEBUG   ] Got command RPT from MCS: ref #271843
2018-10-25 23:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271843  77 58416 85537210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:45:41 [DEBUG   ] Got command BAM from MCS: ref #271859
2018-10-25 23:45:41 [INFO    ] Finished processing BAM request
2018-10-25 23:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271859   8 58416 85541029 A  ERROR'
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-25 23:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-25 23:45:41 [DEBUG   ] spawn_process: at 2018-10-25 23:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-25 23:45:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:45:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-25 23:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:45:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:45:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:45:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:45:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:45:57 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-10-25 23:46:05 [DEBUG   ] Got command BAM from MCS: ref #271860
2018-10-25 23:46:05 [INFO    ] Finished processing BAM request
2018-10-25 23:46:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271860   8 58416 85565025 A  ERROR'
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:46:05 [DEBUG   ] spawn_process: at 2018-10-25 23:46:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:46:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:46:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:46:49 [DEBUG   ] Got command BAM from MCS: ref #271865
2018-10-25 23:46:49 [INFO    ] Finished processing BAM request
2018-10-25 23:46:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271865   8 58416 85609029 A  ERROR'
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:46:49 [DEBUG   ] spawn_process: at 2018-10-25 23:46:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:46:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:46:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-25 23:46:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:46:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:46:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:46:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:46:57 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-10-25 23:47:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:47:17 [DEBUG   ] Got command BAM from MCS: ref #271866
2018-10-25 23:47:17 [INFO    ] Finished processing BAM request
2018-10-25 23:47:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271866   8 58416 85637029 A  ERROR'
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:47:17 [DEBUG   ] spawn_process: at 2018-10-25 23:47:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:47:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-25 23:47:54 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-25 23:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:47:57 [DEBUG   ] Got command BAM from MCS: ref #271867
2018-10-25 23:47:57 [INFO    ] Finished processing BAM request
2018-10-25 23:47:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:47:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271867   8 58416 85677029 A  ERROR'
2018-10-25 23:47:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-25 23:47:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:47:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:47:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:47:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:47:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:47:57 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-25 23:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-25 23:47:57 [DEBUG   ] spawn_process: at 2018-10-25 23:47:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-25 23:48:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:48:21 [DEBUG   ] Got command RPT from MCS: ref #271868
2018-10-25 23:48:21 [DEBUG   ] summary = ERROR
2018-10-25 23:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271868  13 58416 85701093 A  ERRORERROR'
2018-10-25 23:48:21 [DEBUG   ] Got command RPT from MCS: ref #271869
2018-10-25 23:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271869  77 58416 85701297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:48:21 [DEBUG   ] Got command RPT from MCS: ref #271870
2018-10-25 23:48:21 [DEBUG   ] summary = ERROR
2018-10-25 23:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271870  13 58416 85701501 A  ERRORERROR'
2018-10-25 23:48:21 [DEBUG   ] Got command RPT from MCS: ref #271871
2018-10-25 23:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271871  77 58416 85701693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:48:21 [DEBUG   ] Got command RPT from MCS: ref #271872
2018-10-25 23:48:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271872  12 58416 85701897 A  ERRORB ff'
2018-10-25 23:48:29 [DEBUG   ] Got command BAM from MCS: ref #271873
2018-10-25 23:48:29 [INFO    ] Finished processing BAM request
2018-10-25 23:48:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271873   8 58416 85709029 A  ERROR'
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:48:29 [DEBUG   ] spawn_process: at 2018-10-25 23:48:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:48:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:48:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-25 23:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:48:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-25 23:48:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:48:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:48:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:48:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:48:57 [DEBUG   ] Finished updating board flags in 1.274 seconds
2018-10-25 23:49:05 [DEBUG   ] Got command BAM from MCS: ref #271874
2018-10-25 23:49:05 [INFO    ] Finished processing BAM request
2018-10-25 23:49:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271874   8 58416 85745025 A  ERROR'
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:49:05 [DEBUG   ] spawn_process: at 2018-10-25 23:49:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:49:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:49:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:49:41 [DEBUG   ] Got command BAM from MCS: ref #271879
2018-10-25 23:49:41 [INFO    ] Finished processing BAM request
2018-10-25 23:49:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271879   8 58416 85781025 A  ERROR'
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:49:41 [DEBUG   ] spawn_process: at 2018-10-25 23:49:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:49:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:49:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 23:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:49:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-25 23:49:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:49:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:49:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:49:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:49:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:49:57 [DEBUG   ] Finished updating board flags in 1.255 seconds
2018-10-25 23:50:13 [DEBUG   ] Got command BAM from MCS: ref #271880
2018-10-25 23:50:13 [INFO    ] Finished processing BAM request
2018-10-25 23:50:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271880   8 58416 85813029 A  ERROR'
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:50:13 [DEBUG   ] spawn_process: at 2018-10-25 23:50:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:50:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 23:50:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:50:37 [DEBUG   ] Got command RPT from MCS: ref #271881
2018-10-25 23:50:37 [DEBUG   ] summary = ERROR
2018-10-25 23:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271881  13 58416 85837201 A  ERRORERROR'
2018-10-25 23:50:37 [DEBUG   ] Got command RPT from MCS: ref #271882
2018-10-25 23:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271882  77 58416 85837202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:50:53 [DEBUG   ] Got command BAM from MCS: ref #271898
2018-10-25 23:50:53 [INFO    ] Finished processing BAM request
2018-10-25 23:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271898   8 58416 85853033 A  ERROR'
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:50:53 [DEBUG   ] spawn_process: at 2018-10-25 23:50:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:50:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:50:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:50:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-25 23:50:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:50:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:50:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:50:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:50:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:50:57 [DEBUG   ] Finished updating board flags in 1.121 seconds
2018-10-25 23:51:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:51:21 [DEBUG   ] Got command BAM from MCS: ref #271899
2018-10-25 23:51:21 [INFO    ] Finished processing BAM request
2018-10-25 23:51:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271899   8 58416 85881033 A  ERROR'
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:51:21 [DEBUG   ] spawn_process: at 2018-10-25 23:51:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:51:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:51:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-25 23:51:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 23:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:51:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:51:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:51:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:51:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:51:57 [WARNING ] (13, 1, 'bot')
2018-10-25 23:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:51:57 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-25 23:52:05 [DEBUG   ] Got command BAM from MCS: ref #271900
2018-10-25 23:52:05 [INFO    ] Finished processing BAM request
2018-10-25 23:52:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271900   8 58416 85925033 A  ERROR'
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:52:05 [DEBUG   ] spawn_process: at 2018-10-25 23:52:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:52:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:52:29 [DEBUG   ] Got command BAM from MCS: ref #271901
2018-10-25 23:52:29 [INFO    ] Finished processing BAM request
2018-10-25 23:52:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271901   8 58416 85949025 A  ERROR'
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:52:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:52:29 [DEBUG   ] spawn_process: at 2018-10-25 23:52:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:52:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:52:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:52:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:52:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-25 23:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:52:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-25 23:52:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:52:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:52:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:52:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:52:58 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-10-25 23:53:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:53:17 [DEBUG   ] Got command BAM from MCS: ref #271908
2018-10-25 23:53:17 [INFO    ] Finished processing BAM request
2018-10-25 23:53:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271908   8 58416 85997025 A  ERROR'
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-25 23:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-25 23:53:17 [DEBUG   ] spawn_process: at 2018-10-25 23:53:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-25 23:53:21 [DEBUG   ] Got command RPT from MCS: ref #271909
2018-10-25 23:53:21 [DEBUG   ] summary = ERROR
2018-10-25 23:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271909  13 58416 86001178 A  ERRORERROR'
2018-10-25 23:53:21 [DEBUG   ] Got command RPT from MCS: ref #271910
2018-10-25 23:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271910  77 58416 86001381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:53:21 [DEBUG   ] Got command RPT from MCS: ref #271911
2018-10-25 23:53:21 [DEBUG   ] summary = ERROR
2018-10-25 23:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271911  13 58416 86001585 A  ERRORERROR'
2018-10-25 23:53:21 [DEBUG   ] Got command RPT from MCS: ref #271913
2018-10-25 23:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271913  77 58416 86001778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:53:21 [DEBUG   ] Got command RPT from MCS: ref #271915
2018-10-25 23:53:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271915  12 58416 86001981 A  ERRORBŸff'
2018-10-25 23:53:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:53:37 [DEBUG   ] Got command BAM from MCS: ref #271919
2018-10-25 23:53:37 [INFO    ] Finished processing BAM request
2018-10-25 23:53:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271919   8 58416 86017034 A  ERROR'
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:53:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:53:37 [DEBUG   ] spawn_process: at 2018-10-25 23:53:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:53:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-25 23:53:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:53:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:53:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:53:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:53:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:53:58 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-25 23:54:15 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-25 23:54:29 [DEBUG   ] Got command BAM from MCS: ref #271920
2018-10-25 23:54:29 [INFO    ] Finished processing BAM request
2018-10-25 23:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271920   8 58416 86069034 A  ERROR'
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:54:29 [DEBUG   ] spawn_process: at 2018-10-25 23:54:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:54:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:54:45 [DEBUG   ] Got command BAM from MCS: ref #271921
2018-10-25 23:54:45 [INFO    ] Finished processing BAM request
2018-10-25 23:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271921   8 58416 86085033 A  ERROR'
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-25 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-25 23:54:45 [DEBUG   ] spawn_process: at 2018-10-25 23:54:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-25 23:54:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-25 23:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-25 23:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:54:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:54:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:54:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:54:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:54:58 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-25 23:55:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:55:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:55:37 [DEBUG   ] Got command RPT from MCS: ref #271922
2018-10-25 23:55:37 [DEBUG   ] summary = ERROR
2018-10-25 23:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271922  13 58416 86137213 A  ERRORERROR'
2018-10-25 23:55:37 [DEBUG   ] Got command RPT from MCS: ref #271923
2018-10-25 23:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271923  77 58416 86137214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:55:41 [DEBUG   ] Got command BAM from MCS: ref #271943
2018-10-25 23:55:41 [INFO    ] Finished processing BAM request
2018-10-25 23:55:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:55:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271943   8 58416 86141033 A  ERROR'
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-25 23:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-25 23:55:41 [DEBUG   ] spawn_process: at 2018-10-25 23:55:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-25 23:55:53 [DEBUG   ] Got command BAM from MCS: ref #271944
2018-10-25 23:55:53 [INFO    ] Finished processing BAM request
2018-10-25 23:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271944   8 58416 86153025 A  ERROR'
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:55:53 [DEBUG   ] spawn_process: at 2018-10-25 23:55:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:55:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-25 23:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-25 23:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:55:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-25 23:55:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:55:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:55:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:55:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:55:58 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-25 23:56:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:56:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:56:53 [DEBUG   ] Got command BAM from MCS: ref #271945
2018-10-25 23:56:53 [INFO    ] Finished processing BAM request
2018-10-25 23:56:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271945   8 58416 86213029 A  ERROR'
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-25 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-25 23:56:53 [DEBUG   ] spawn_process: at 2018-10-25 23:56:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-25 23:56:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-25 23:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-25 23:56:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:56:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:56:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:56:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:56:58 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-25 23:57:01 [DEBUG   ] Got command BAM from MCS: ref #271946
2018-10-25 23:57:01 [INFO    ] Finished processing BAM request
2018-10-25 23:57:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271946   8 58416 86221029 A  ERROR'
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:57:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:57:01 [DEBUG   ] spawn_process: at 2018-10-25 23:57:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:57:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:57:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:57:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:57:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:57:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:57:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:57:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:57:58 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-10-25 23:58:05 [DEBUG   ] Got command BAM from MCS: ref #271947
2018-10-25 23:58:05 [INFO    ] Finished processing BAM request
2018-10-25 23:58:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271947   8 58416 86285033 A  ERROR'
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:58:05 [DEBUG   ] spawn_process: at 2018-10-25 23:58:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:58:09 [DEBUG   ] Got command BAM from MCS: ref #271948
2018-10-25 23:58:09 [INFO    ] Finished processing BAM request
2018-10-25 23:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271948   8 58416 86289033 A  ERROR'
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:58:09 [DEBUG   ] spawn_process: at 2018-10-25 23:58:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:58:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:58:21 [DEBUG   ] Got command RPT from MCS: ref #271949
2018-10-25 23:58:21 [DEBUG   ] summary = ERROR
2018-10-25 23:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271949  13 58416 86301269 A  ERRORERROR'
2018-10-25 23:58:21 [DEBUG   ] Got command RPT from MCS: ref #271950
2018-10-25 23:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271950  77 58416 86301473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:58:21 [DEBUG   ] Got command RPT from MCS: ref #271951
2018-10-25 23:58:21 [DEBUG   ] summary = ERROR
2018-10-25 23:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271951  13 58416 86301665 A  ERRORERROR'
2018-10-25 23:58:21 [DEBUG   ] Got command RPT from MCS: ref #271952
2018-10-25 23:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-25 23:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271952  77 58416 86301869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-25 23:58:22 [DEBUG   ] Got command RPT from MCS: ref #271953
2018-10-25 23:58:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-25 23:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271953  12 58416 86302073 A  ERRORBŸff'
2018-10-25 23:58:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-25 23:58:53 [DEBUG   ] Got command BAM from MCS: ref #271959
2018-10-25 23:58:53 [INFO    ] Finished processing BAM request
2018-10-25 23:58:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271959   8 58416 86333025 A  ERROR'
2018-10-25 23:58:53 [DEBUG   ] Got command BAM from MCS: ref #271958
2018-10-25 23:58:53 [INFO    ] Finished processing BAM request
2018-10-25 23:58:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271958   8 58416 86333029 A  ERROR'
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:58:53 [DEBUG   ] spawn_process: at 2018-10-25 23:58:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:58:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:58:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:58:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:58:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:58:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:58:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:58:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:58:58 [DEBUG   ] Finished updating board flags in 1.079 seconds
2018-10-25 23:59:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:59:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:59:43 [DEBUG   ] Got command BAM from MCS: ref #271962
2018-10-25 23:59:43 [INFO    ] Finished processing BAM request
2018-10-25 23:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271962   8 58416 86383029 A  ERROR'
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-25 23:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-25 23:59:43 [DEBUG   ] spawn_process: at 2018-10-25 23:59:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-25 23:59:46 [DEBUG   ] Got command BAM from MCS: ref #271963
2018-10-25 23:59:46 [INFO    ] Finished processing BAM request
2018-10-25 23:59:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-25 23:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271963   8 58416 86386033 A  ERROR'
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-25 23:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-25 23:59:46 [DEBUG   ] spawn_process: at 2018-10-25 23:59:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-25 23:59:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-25 23:59:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-25 23:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-25 23:59:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-25 23:59:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-25 23:59:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:59:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:59:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:59:58 [WARNING ] (13, 1, 'bot')
2018-10-25 23:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-25 23:59:58 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-10-26 00:00:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 00:00:33 [DEBUG   ] Got command BAM from MCS: ref #271964
2018-10-26 00:00:33 [INFO    ] Finished processing BAM request
2018-10-26 00:00:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271964   8 58417    33025 A  ERROR'
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:00:33 [DEBUG   ] spawn_process: at 2018-10-26 00:00:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:00:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:00:37 [DEBUG   ] Got command RPT from MCS: ref #271966
2018-10-26 00:00:37 [DEBUG   ] summary = ERROR
2018-10-26 00:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271966  13 58417    37213 A  ERRORERROR'
2018-10-26 00:00:37 [DEBUG   ] Got command RPT from MCS: ref #271967
2018-10-26 00:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271967  77 58417    37214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:00:38 [DEBUG   ] Got command BAM from MCS: ref #271965
2018-10-26 00:00:38 [INFO    ] Finished processing BAM request
2018-10-26 00:00:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:00:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271965   8 58417    38033 A  ERROR'
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:00:38 [DEBUG   ] spawn_process: at 2018-10-26 00:00:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:00:53 [DEBUG   ] Got command BAM from MCS: ref #271984
2018-10-26 00:00:53 [INFO    ] Finished processing BAM request
2018-10-26 00:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271984   8 58417    53025 A  ERROR'
2018-10-26 00:00:53 [DEBUG   ] Got command BAM from MCS: ref #271983
2018-10-26 00:00:53 [INFO    ] Finished processing BAM request
2018-10-26 00:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271983   8 58417    53029 A  ERROR'
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:00:53 [DEBUG   ] spawn_process: at 2018-10-26 00:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:00:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:00:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:00:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:00:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:00:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:00:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:00:58 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-26 00:01:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:01:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:01:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:01:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:01:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:01:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:01:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:01:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:01:58 [DEBUG   ] Finished updating board flags in 1.323 seconds
2018-10-26 00:02:01 [DEBUG   ] Got command BAM from MCS: ref #271991
2018-10-26 00:02:01 [INFO    ] Finished processing BAM request
2018-10-26 00:02:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271991   8 58417   121029 A  ERROR'
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:02:01 [DEBUG   ] spawn_process: at 2018-10-26 00:02:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:02:05 [DEBUG   ] Got command BAM from MCS: ref #271992
2018-10-26 00:02:05 [INFO    ] Finished processing BAM request
2018-10-26 00:02:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271992   8 58417   125033 A  ERROR'
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:02:05 [DEBUG   ] spawn_process: at 2018-10-26 00:02:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:02:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:02:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:02:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:02:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:02:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:02:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:02:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:02:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:02:58 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-10-26 00:03:09 [DEBUG   ] Got command BAM from MCS: ref #271995
2018-10-26 00:03:09 [INFO    ] Finished processing BAM request
2018-10-26 00:03:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:03:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271995   8 58417   189033 A  ERROR'
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:03:09 [DEBUG   ] spawn_process: at 2018-10-26 00:03:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:03:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:03:17 [DEBUG   ] Got command BAM from MCS: ref #271996
2018-10-26 00:03:17 [INFO    ] Finished processing BAM request
2018-10-26 00:03:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   271996   8 58417   197029 A  ERROR'
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:03:17 [DEBUG   ] spawn_process: at 2018-10-26 00:03:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:03:21 [DEBUG   ] Got command RPT from MCS: ref #271997
2018-10-26 00:03:21 [DEBUG   ] summary = ERROR
2018-10-26 00:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271997  13 58417   201353 A  ERRORERROR'
2018-10-26 00:03:21 [DEBUG   ] Got command RPT from MCS: ref #271998
2018-10-26 00:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271998  77 58417   201557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:03:21 [DEBUG   ] Got command RPT from MCS: ref #271999
2018-10-26 00:03:21 [DEBUG   ] summary = ERROR
2018-10-26 00:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   271999  13 58417   201749 A  ERRORERROR'
2018-10-26 00:03:21 [DEBUG   ] Got command RPT from MCS: ref #272001
2018-10-26 00:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272001  77 58417   201953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:03:22 [DEBUG   ] Got command RPT from MCS: ref #272003
2018-10-26 00:03:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272003  12 58417   202157 A  ERRORB ff'
2018-10-26 00:03:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:03:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:03:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 00:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:03:58 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-10-26 00:04:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:04:17 [DEBUG   ] Got command BAM from MCS: ref #272007
2018-10-26 00:04:17 [INFO    ] Finished processing BAM request
2018-10-26 00:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272007   8 58417   257029 A  ERROR'
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:04:17 [DEBUG   ] spawn_process: at 2018-10-26 00:04:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:04:29 [DEBUG   ] Got command BAM from MCS: ref #272008
2018-10-26 00:04:29 [INFO    ] Finished processing BAM request
2018-10-26 00:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272008   8 58417   269033 A  ERROR'
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:04:29 [DEBUG   ] spawn_process: at 2018-10-26 00:04:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:04:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:04:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 00:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:04:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:04:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:04:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:04:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:04:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:04:59 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-10-26 00:05:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:05:25 [DEBUG   ] Got command BAM from MCS: ref #272013
2018-10-26 00:05:25 [INFO    ] Finished processing BAM request
2018-10-26 00:05:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272013   8 58417   325033 A  ERROR'
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:05:25 [DEBUG   ] spawn_process: at 2018-10-26 00:05:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:05:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:05:37 [DEBUG   ] Got command RPT from MCS: ref #272014
2018-10-26 00:05:37 [DEBUG   ] summary = ERROR
2018-10-26 00:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272014  13 58417   337213 A  ERRORERROR'
2018-10-26 00:05:37 [DEBUG   ] Got command RPT from MCS: ref #272015
2018-10-26 00:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272015  77 58417   337214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:05:41 [DEBUG   ] Got command BAM from MCS: ref #272031
2018-10-26 00:05:41 [INFO    ] Finished processing BAM request
2018-10-26 00:05:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:05:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272031   8 58417   341037 A  ERROR'
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:05:41 [DEBUG   ] spawn_process: at 2018-10-26 00:05:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:05:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:05:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:05:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:05:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:05:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:05:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:05:59 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-26 00:06:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:06:33 [DEBUG   ] Got command BAM from MCS: ref #272032
2018-10-26 00:06:33 [INFO    ] Finished processing BAM request
2018-10-26 00:06:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272032   8 58417   393029 A  ERROR'
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:06:33 [DEBUG   ] spawn_process: at 2018-10-26 00:06:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:06:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:06:53 [DEBUG   ] Got command BAM from MCS: ref #272033
2018-10-26 00:06:53 [INFO    ] Finished processing BAM request
2018-10-26 00:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272033   8 58417   413033 A  ERROR'
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:06:53 [DEBUG   ] spawn_process: at 2018-10-26 00:06:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:06:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 00:06:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:06:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:06:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:06:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:06:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:06:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:06:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:06:59 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-10-26 00:07:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:07:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:07:41 [DEBUG   ] Got command BAM from MCS: ref #272038
2018-10-26 00:07:41 [INFO    ] Finished processing BAM request
2018-10-26 00:07:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272038   8 58417   461025 A  ERROR'
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:07:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:07:41 [DEBUG   ] spawn_process: at 2018-10-26 00:07:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:07:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:07:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:07:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:07:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:07:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:07:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:07:59 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-10-26 00:08:04 [DEBUG   ] Got command BAM from MCS: ref #272039
2018-10-26 00:08:04 [INFO    ] Finished processing BAM request
2018-10-26 00:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272039   8 58417   484033 A  ERROR'
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:08:04 [DEBUG   ] spawn_process: at 2018-10-26 00:08:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:08:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:08:21 [DEBUG   ] Got command RPT from MCS: ref #272040
2018-10-26 00:08:21 [DEBUG   ] summary = ERROR
2018-10-26 00:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272040  13 58417   501441 A  ERRORERROR'
2018-10-26 00:08:21 [DEBUG   ] Got command RPT from MCS: ref #272041
2018-10-26 00:08:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272041  77 58417   501645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:08:21 [DEBUG   ] Got command RPT from MCS: ref #272042
2018-10-26 00:08:21 [DEBUG   ] summary = ERROR
2018-10-26 00:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272042  13 58417   501837 A  ERRORERROR'
2018-10-26 00:08:22 [DEBUG   ] Got command RPT from MCS: ref #272043
2018-10-26 00:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272043  77 58417   502041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:08:22 [DEBUG   ] Got command RPT from MCS: ref #272044
2018-10-26 00:08:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272044  12 58417   502245 A  ERRORBŸff'
2018-10-26 00:08:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 00:08:49 [DEBUG   ] Got command BAM from MCS: ref #272045
2018-10-26 00:08:49 [INFO    ] Finished processing BAM request
2018-10-26 00:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272045   8 58417   529025 A  ERROR'
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:08:49 [DEBUG   ] spawn_process: at 2018-10-26 00:08:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:08:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 00:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 00:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:08:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:08:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:08:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:08:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:08:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:08:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:08:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:08:59 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-10-26 00:09:15 [DEBUG   ] Got command BAM from MCS: ref #272046
2018-10-26 00:09:15 [INFO    ] Finished processing BAM request
2018-10-26 00:09:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272046   8 58417   555029 A  ERROR'
2018-10-26 00:09:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:09:15 [DEBUG   ] spawn_process: at 2018-10-26 00:09:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:09:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:09:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:09:57 [DEBUG   ] Got command BAM from MCS: ref #272047
2018-10-26 00:09:57 [INFO    ] Finished processing BAM request
2018-10-26 00:09:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272047   8 58417   597033 A  ERROR'
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:09:57 [DEBUG   ] spawn_process: at 2018-10-26 00:09:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 00:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:10:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:10:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:10:00 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-26 00:10:15 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-10-26 00:10:26 [DEBUG   ] Got command BAM from MCS: ref #272048
2018-10-26 00:10:26 [INFO    ] Finished processing BAM request
2018-10-26 00:10:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272048   8 58417   626033 A  ERROR'
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:10:26 [DEBUG   ] spawn_process: at 2018-10-26 00:10:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:10:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:10:37 [DEBUG   ] Got command RPT from MCS: ref #272049
2018-10-26 00:10:37 [DEBUG   ] summary = ERROR
2018-10-26 00:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272049  13 58417   637213 A  ERRORERROR'
2018-10-26 00:10:37 [DEBUG   ] Got command RPT from MCS: ref #272050
2018-10-26 00:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272050  77 58417   637214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:10:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:10:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:10:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:10:59 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-10-26 00:11:05 [DEBUG   ] Got command BAM from MCS: ref #272070
2018-10-26 00:11:05 [INFO    ] Finished processing BAM request
2018-10-26 00:11:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272070   8 58417   665025 A  ERROR'
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:11:05 [DEBUG   ] spawn_process: at 2018-10-26 00:11:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:11:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 00:11:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:11:37 [DEBUG   ] Got command BAM from MCS: ref #272071
2018-10-26 00:11:37 [INFO    ] Finished processing BAM request
2018-10-26 00:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272071   8 58417   697025 A  ERROR'
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:11:37 [DEBUG   ] spawn_process: at 2018-10-26 00:11:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:11:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:11:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:11:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:11:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:11:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:11:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:11:59 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-10-26 00:12:13 [DEBUG   ] Got command BAM from MCS: ref #272072
2018-10-26 00:12:13 [INFO    ] Finished processing BAM request
2018-10-26 00:12:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272072   8 58417   733025 A  ERROR'
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:12:13 [DEBUG   ] spawn_process: at 2018-10-26 00:12:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:12:16 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-26 00:12:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:12:48 [DEBUG   ] Got command BAM from MCS: ref #272073
2018-10-26 00:12:48 [INFO    ] Finished processing BAM request
2018-10-26 00:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272073   8 58417   768029 A  ERROR'
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:12:48 [DEBUG   ] spawn_process: at 2018-10-26 00:12:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:12:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 00:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 00:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:12:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:12:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:12:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:12:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:12:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:12:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:12:59 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-10-26 00:13:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:13:21 [DEBUG   ] Got command BAM from MCS: ref #272076
2018-10-26 00:13:21 [INFO    ] Finished processing BAM request
2018-10-26 00:13:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272076   8 58417   801025 A  ERROR'
2018-10-26 00:13:21 [DEBUG   ] Got command RPT from MCS: ref #272077
2018-10-26 00:13:21 [DEBUG   ] summary = ERROR
2018-10-26 00:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272077  13 58417   801517 A  ERRORERROR'
2018-10-26 00:13:21 [DEBUG   ] Got command RPT from MCS: ref #272078
2018-10-26 00:13:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272078  77 58417   801722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:13:21 [DEBUG   ] Got command RPT from MCS: ref #272079
2018-10-26 00:13:21 [DEBUG   ] summary = ERROR
2018-10-26 00:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272079  13 58417   801926 A  ERRORERROR'
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:13:21 [DEBUG   ] spawn_process: at 2018-10-26 00:13:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:13:22 [DEBUG   ] Got command RPT from MCS: ref #272081
2018-10-26 00:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272081  77 58417   802129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:13:22 [DEBUG   ] Got command RPT from MCS: ref #272083
2018-10-26 00:13:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272083  12 58417   802321 A  ERRORB ff'
2018-10-26 00:13:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:13:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:13:59 [DEBUG   ] Got command BAM from MCS: ref #272091
2018-10-26 00:13:59 [INFO    ] Finished processing BAM request
2018-10-26 00:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272091   8 58417   839041 A  ERROR'
2018-10-26 00:13:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:13:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:13:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:13:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:13:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:13:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:13:59 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:13:59 [DEBUG   ] spawn_process: at 2018-10-26 00:13:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:14:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 00:14:29 [DEBUG   ] Got command BAM from MCS: ref #272092
2018-10-26 00:14:29 [INFO    ] Finished processing BAM request
2018-10-26 00:14:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272092   8 58417   869033 A  ERROR'
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:14:29 [DEBUG   ] spawn_process: at 2018-10-26 00:14:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:14:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:14:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:14:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 00:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:14:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:14:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:14:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:14:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:14:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:14:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:14:59 [DEBUG   ] Finished updating board flags in 1.171 seconds
2018-10-26 00:15:10 [DEBUG   ] Got command BAM from MCS: ref #272093
2018-10-26 00:15:10 [INFO    ] Finished processing BAM request
2018-10-26 00:15:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272093   8 58417   910033 A  ERROR'
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:15:10 [DEBUG   ] spawn_process: at 2018-10-26 00:15:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:15:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:15:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:15:37 [DEBUG   ] Got command BAM from MCS: ref #272094
2018-10-26 00:15:37 [INFO    ] Finished processing BAM request
2018-10-26 00:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272094   8 58417   937029 A  ERROR'
2018-10-26 00:15:37 [DEBUG   ] Got command RPT from MCS: ref #272095
2018-10-26 00:15:37 [DEBUG   ] summary = ERROR
2018-10-26 00:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272095  13 58417   937209 A  ERRORERROR'
2018-10-26 00:15:37 [DEBUG   ] Got command RPT from MCS: ref #272096
2018-10-26 00:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272096  77 58417   937210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:15:37 [DEBUG   ] spawn_process: at 2018-10-26 00:15:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:15:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:15:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:15:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:15:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:15:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:15:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:15:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:15:59 [DEBUG   ] Finished updating board flags in 1.026 seconds
2018-10-26 00:16:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:16:21 [DEBUG   ] Got command BAM from MCS: ref #272112
2018-10-26 00:16:21 [INFO    ] Finished processing BAM request
2018-10-26 00:16:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272112   8 58417   981033 A  ERROR'
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:16:21 [DEBUG   ] spawn_process: at 2018-10-26 00:16:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:16:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:16:45 [DEBUG   ] Got command BAM from MCS: ref #272117
2018-10-26 00:16:45 [INFO    ] Finished processing BAM request
2018-10-26 00:16:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272117   8 58417  1005029 A  ERROR'
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:16:45 [DEBUG   ] spawn_process: at 2018-10-26 00:16:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:16:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:16:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:16:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:16:59 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-10-26 00:17:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:17:32 [DEBUG   ] Got command BAM from MCS: ref #272118
2018-10-26 00:17:32 [INFO    ] Finished processing BAM request
2018-10-26 00:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272118   8 58417  1052033 A  ERROR'
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:17:32 [DEBUG   ] spawn_process: at 2018-10-26 00:17:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:17:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:17:53 [DEBUG   ] Got command BAM from MCS: ref #272119
2018-10-26 00:17:53 [INFO    ] Finished processing BAM request
2018-10-26 00:17:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:17:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272119   8 58417  1073029 A  ERROR'
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:17:53 [DEBUG   ] spawn_process: at 2018-10-26 00:17:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:17:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:17:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:17:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:17:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:17:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:17:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:17:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:17:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:17:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:17:59 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-26 00:18:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:18:21 [DEBUG   ] Got command RPT from MCS: ref #272120
2018-10-26 00:18:21 [DEBUG   ] summary = ERROR
2018-10-26 00:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272120  13 58417  1101605 A  ERRORERROR'
2018-10-26 00:18:21 [DEBUG   ] Got command RPT from MCS: ref #272121
2018-10-26 00:18:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272121  77 58417  1101809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:18:22 [DEBUG   ] Got command RPT from MCS: ref #272122
2018-10-26 00:18:22 [DEBUG   ] summary = ERROR
2018-10-26 00:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272122  13 58417  1102013 A  ERRORERROR'
2018-10-26 00:18:22 [DEBUG   ] Got command RPT from MCS: ref #272123
2018-10-26 00:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272123  77 58417  1102217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:18:22 [DEBUG   ] Got command RPT from MCS: ref #272124
2018-10-26 00:18:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272124  12 58417  1102409 A  ERRORB ff'
2018-10-26 00:18:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:18:43 [DEBUG   ] Got command BAM from MCS: ref #272125
2018-10-26 00:18:43 [INFO    ] Finished processing BAM request
2018-10-26 00:18:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272125   8 58417  1123029 A  ERROR'
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:18:43 [DEBUG   ] spawn_process: at 2018-10-26 00:18:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:18:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:18:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:18:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:18:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:18:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:18:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:18:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:18:59 [WARNING ] (13, 1, 'bot')
2018-10-26 00:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:18:59 [DEBUG   ] Finished updating board flags in 0.951 seconds
2018-10-26 00:19:01 [DEBUG   ] Got command BAM from MCS: ref #272126
2018-10-26 00:19:01 [INFO    ] Finished processing BAM request
2018-10-26 00:19:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272126   8 58417  1141033 A  ERROR'
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:19:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:19:01 [DEBUG   ] spawn_process: at 2018-10-26 00:19:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:19:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:19:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:19:54 [DEBUG   ] Got command BAM from MCS: ref #272131
2018-10-26 00:19:54 [INFO    ] Finished processing BAM request
2018-10-26 00:19:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272131   8 58417  1194025 A  ERROR'
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:19:54 [DEBUG   ] spawn_process: at 2018-10-26 00:19:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:19:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:20:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:20:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:20:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:20:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:20:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:20:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:20:00 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-26 00:20:09 [DEBUG   ] Got command BAM from MCS: ref #272132
2018-10-26 00:20:09 [INFO    ] Finished processing BAM request
2018-10-26 00:20:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272132   8 58417  1209029 A  ERROR'
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:20:09 [DEBUG   ] spawn_process: at 2018-10-26 00:20:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:20:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:20:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:20:37 [DEBUG   ] Got command RPT from MCS: ref #272133
2018-10-26 00:20:37 [DEBUG   ] summary = ERROR
2018-10-26 00:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272133  13 58417  1237209 A  ERRORERROR'
2018-10-26 00:20:37 [DEBUG   ] Got command RPT from MCS: ref #272134
2018-10-26 00:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272134  77 58417  1237210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:20:53 [DEBUG   ] Got command BAM from MCS: ref #272151
2018-10-26 00:20:53 [INFO    ] Finished processing BAM request
2018-10-26 00:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272151   8 58417  1253029 A  ERROR'
2018-10-26 00:20:53 [DEBUG   ] Got command BAM from MCS: ref #272150
2018-10-26 00:20:53 [INFO    ] Finished processing BAM request
2018-10-26 00:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272150   8 58417  1253033 A  ERROR'
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:20:53 [DEBUG   ] spawn_process: at 2018-10-26 00:20:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:20:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:21:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:21:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:21:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:21:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:21:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:21:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:21:00 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-10-26 00:21:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 00:21:32 [DEBUG   ] Got command BAM from MCS: ref #272154
2018-10-26 00:21:32 [INFO    ] Finished processing BAM request
2018-10-26 00:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272154   8 58417  1292025 A  ERROR'
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:21:32 [DEBUG   ] spawn_process: at 2018-10-26 00:21:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:21:33 [DEBUG   ] Got command BAM from MCS: ref #272155
2018-10-26 00:21:33 [INFO    ] Finished processing BAM request
2018-10-26 00:21:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272155   8 58417  1293029 A  ERROR'
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:21:33 [DEBUG   ] spawn_process: at 2018-10-26 00:21:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:21:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:21:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:22:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:22:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:22:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:22:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:22:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:22:00 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-26 00:22:11 [DEBUG   ] Got command BAM from MCS: ref #272156
2018-10-26 00:22:11 [INFO    ] Finished processing BAM request
2018-10-26 00:22:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:22:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272156   8 58417  1331033 A  ERROR'
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:22:11 [DEBUG   ] spawn_process: at 2018-10-26 00:22:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:22:13 [DEBUG   ] Got command BAM from MCS: ref #272157
2018-10-26 00:22:13 [INFO    ] Finished processing BAM request
2018-10-26 00:22:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:22:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272157   8 58417  1333029 A  ERROR'
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:22:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:22:13 [DEBUG   ] spawn_process: at 2018-10-26 00:22:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:22:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:22:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:22:50 [DEBUG   ] Got command BAM from MCS: ref #272162
2018-10-26 00:22:50 [INFO    ] Finished processing BAM request
2018-10-26 00:22:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:22:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272162   8 58417  1370033 A  ERROR'
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:22:50 [DEBUG   ] spawn_process: at 2018-10-26 00:22:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:22:52 [DEBUG   ] Got command BAM from MCS: ref #272163
2018-10-26 00:22:52 [INFO    ] Finished processing BAM request
2018-10-26 00:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272163   8 58417  1372029 A  ERROR'
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:22:52 [DEBUG   ] spawn_process: at 2018-10-26 00:22:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:22:53 [DEBUG   ] Got command BAM from MCS: ref #272165
2018-10-26 00:22:53 [INFO    ] Finished processing BAM request
2018-10-26 00:22:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:22:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272165   8 58417  1373029 A  ERROR'
2018-10-26 00:22:53 [DEBUG   ] Got command BAM from MCS: ref #272164
2018-10-26 00:22:53 [INFO    ] Finished processing BAM request
2018-10-26 00:22:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:22:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272164   8 58417  1373033 A  ERROR'
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:22:53 [DEBUG   ] spawn_process: at 2018-10-26 00:22:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:22:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:23:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 00:23:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:23:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:23:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:23:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:23:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:23:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:23:00 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-10-26 00:23:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:23:21 [DEBUG   ] Got command RPT from MCS: ref #272170
2018-10-26 00:23:21 [DEBUG   ] summary = ERROR
2018-10-26 00:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272170  13 58417  1401697 A  ERRORERROR'
2018-10-26 00:23:21 [DEBUG   ] Got command RPT from MCS: ref #272171
2018-10-26 00:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272171  77 58417  1401901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:23:22 [DEBUG   ] Got command RPT from MCS: ref #272172
2018-10-26 00:23:22 [DEBUG   ] summary = ERROR
2018-10-26 00:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272172  13 58417  1402093 A  ERRORERROR'
2018-10-26 00:23:22 [DEBUG   ] Got command RPT from MCS: ref #272174
2018-10-26 00:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272174  77 58417  1402297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:23:22 [DEBUG   ] Got command RPT from MCS: ref #272175
2018-10-26 00:23:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272175  12 58417  1402501 A  ERRORB ff'
2018-10-26 00:23:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:23:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:24:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:24:01 [DEBUG   ] Got command BAM from MCS: ref #272180
2018-10-26 00:24:01 [INFO    ] Finished processing BAM request
2018-10-26 00:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272180   8 58417  1441025 A  ERROR'
2018-10-26 00:24:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:24:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:24:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:24:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:24:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:24:01 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:24:01 [DEBUG   ] spawn_process: at 2018-10-26 00:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:24:04 [DEBUG   ] Got command BAM from MCS: ref #272181
2018-10-26 00:24:04 [INFO    ] Finished processing BAM request
2018-10-26 00:24:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272181   8 58417  1444029 A  ERROR'
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:24:04 [DEBUG   ] spawn_process: at 2018-10-26 00:24:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:24:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:24:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:24:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:25:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:25:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:25:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:25:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:25:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:25:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:25:00 [DEBUG   ] Finished updating board flags in 1.223 seconds
2018-10-26 00:25:09 [DEBUG   ] Got command BAM from MCS: ref #272182
2018-10-26 00:25:09 [INFO    ] Finished processing BAM request
2018-10-26 00:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272182   8 58417  1509025 A  ERROR'
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:25:09 [DEBUG   ] spawn_process: at 2018-10-26 00:25:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:25:15 [DEBUG   ] Got command BAM from MCS: ref #272183
2018-10-26 00:25:15 [INFO    ] Finished processing BAM request
2018-10-26 00:25:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272183   8 58417  1515029 A  ERROR'
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:25:15 [DEBUG   ] spawn_process: at 2018-10-26 00:25:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:25:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 00:25:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:25:37 [DEBUG   ] Got command RPT from MCS: ref #272184
2018-10-26 00:25:37 [DEBUG   ] summary = ERROR
2018-10-26 00:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272184  13 58417  1537217 A  ERRORERROR'
2018-10-26 00:25:37 [DEBUG   ] Got command RPT from MCS: ref #272185
2018-10-26 00:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272185  77 58417  1537218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:25:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:26:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:26:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:26:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:26:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:26:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:26:00 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-10-26 00:26:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:26:17 [DEBUG   ] Got command BAM from MCS: ref #272205
2018-10-26 00:26:17 [INFO    ] Finished processing BAM request
2018-10-26 00:26:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272205   8 58417  1577025 A  ERROR'
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:26:17 [DEBUG   ] spawn_process: at 2018-10-26 00:26:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:26:26 [DEBUG   ] Got command BAM from MCS: ref #272206
2018-10-26 00:26:26 [INFO    ] Finished processing BAM request
2018-10-26 00:26:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272206   8 58417  1586029 A  ERROR'
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:26:26 [DEBUG   ] spawn_process: at 2018-10-26 00:26:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:26:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:26:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 00:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:27:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:27:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:27:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:27:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:27:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:27:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:27:00 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-10-26 00:27:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 00:27:25 [DEBUG   ] Got command BAM from MCS: ref #272207
2018-10-26 00:27:25 [INFO    ] Finished processing BAM request
2018-10-26 00:27:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272207   8 58417  1645033 A  ERROR'
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:27:25 [DEBUG   ] spawn_process: at 2018-10-26 00:27:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:27:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:27:37 [DEBUG   ] Got command BAM from MCS: ref #272208
2018-10-26 00:27:37 [INFO    ] Finished processing BAM request
2018-10-26 00:27:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272208   8 58417  1657029 A  ERROR'
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:27:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:27:37 [DEBUG   ] spawn_process: at 2018-10-26 00:27:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:27:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 00:28:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:28:00 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-26 00:28:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:28:21 [DEBUG   ] Got command RPT from MCS: ref #272209
2018-10-26 00:28:21 [DEBUG   ] summary = ERROR
2018-10-26 00:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272209  13 58417  1701785 A  ERRORERROR'
2018-10-26 00:28:21 [DEBUG   ] Got command RPT from MCS: ref #272210
2018-10-26 00:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272210  77 58417  1701977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:28:22 [DEBUG   ] Got command RPT from MCS: ref #272211
2018-10-26 00:28:22 [DEBUG   ] summary = ERROR
2018-10-26 00:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272211  13 58417  1702181 A  ERRORERROR'
2018-10-26 00:28:22 [DEBUG   ] Got command RPT from MCS: ref #272212
2018-10-26 00:28:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272212  77 58417  1702385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:28:22 [DEBUG   ] Got command RPT from MCS: ref #272213
2018-10-26 00:28:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272213  12 58417  1702589 A  ERRORB ff'
2018-10-26 00:28:33 [DEBUG   ] Got command BAM from MCS: ref #272214
2018-10-26 00:28:33 [INFO    ] Finished processing BAM request
2018-10-26 00:28:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272214   8 58417  1713033 A  ERROR'
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:28:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:28:33 [DEBUG   ] spawn_process: at 2018-10-26 00:28:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:28:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:28:48 [DEBUG   ] Got command BAM from MCS: ref #272219
2018-10-26 00:28:48 [INFO    ] Finished processing BAM request
2018-10-26 00:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272219   8 58417  1728029 A  ERROR'
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:28:48 [DEBUG   ] spawn_process: at 2018-10-26 00:28:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:28:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:29:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:29:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:29:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:29:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:29:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:29:00 [WARNING ] (13, 1, 'bot')
2018-10-26 00:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:29:00 [DEBUG   ] Finished updating board flags in 0.978 seconds
2018-10-26 00:29:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:29:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:29:41 [DEBUG   ] Got command BAM from MCS: ref #272220
2018-10-26 00:29:41 [INFO    ] Finished processing BAM request
2018-10-26 00:29:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272220   8 58417  1781033 A  ERROR'
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:29:41 [DEBUG   ] spawn_process: at 2018-10-26 00:29:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:29:56 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 00:29:59 [DEBUG   ] Got command BAM from MCS: ref #272221
2018-10-26 00:29:59 [INFO    ] Finished processing BAM request
2018-10-26 00:29:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272221   8 58417  1799025 A  ERROR'
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:29:59 [DEBUG   ] spawn_process: at 2018-10-26 00:29:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:30:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:30:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:30:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:30:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:30:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:30:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:30:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:30:01 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-26 00:30:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:30:37 [DEBUG   ] Got command RPT from MCS: ref #272222
2018-10-26 00:30:37 [DEBUG   ] summary = ERROR
2018-10-26 00:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272222  13 58417  1837217 A  ERRORERROR'
2018-10-26 00:30:37 [DEBUG   ] Got command RPT from MCS: ref #272223
2018-10-26 00:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272223  77 58417  1837218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:30:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:30:49 [DEBUG   ] Got command BAM from MCS: ref #272239
2018-10-26 00:30:49 [INFO    ] Finished processing BAM request
2018-10-26 00:30:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272239   8 58417  1849037 A  ERROR'
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:30:50 [DEBUG   ] spawn_process: at 2018-10-26 00:30:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:30:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:31:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:31:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:31:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:31:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:31:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:31:01 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-26 00:31:10 [DEBUG   ] Got command BAM from MCS: ref #272240
2018-10-26 00:31:10 [INFO    ] Finished processing BAM request
2018-10-26 00:31:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272240   8 58417  1870033 A  ERROR'
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:31:10 [DEBUG   ] spawn_process: at 2018-10-26 00:31:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:31:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:31:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:31:57 [DEBUG   ] Got command BAM from MCS: ref #272245
2018-10-26 00:31:57 [INFO    ] Finished processing BAM request
2018-10-26 00:31:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272245   8 58417  1917033 A  ERROR'
2018-10-26 00:31:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:31:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:31:57 [DEBUG   ] spawn_process: at 2018-10-26 00:31:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 00:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:32:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:32:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:32:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:32:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:32:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:32:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:32:01 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-10-26 00:32:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:32:21 [DEBUG   ] Got command BAM from MCS: ref #272246
2018-10-26 00:32:21 [INFO    ] Finished processing BAM request
2018-10-26 00:32:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272246   8 58417  1941025 A  ERROR'
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:32:21 [DEBUG   ] spawn_process: at 2018-10-26 00:32:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:32:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 00:32:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 00:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:33:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:33:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:33:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:33:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:33:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:33:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:33:01 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-10-26 00:33:05 [DEBUG   ] Got command BAM from MCS: ref #272249
2018-10-26 00:33:05 [INFO    ] Finished processing BAM request
2018-10-26 00:33:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272249   8 58417  1985033 A  ERROR'
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:33:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:33:05 [DEBUG   ] spawn_process: at 2018-10-26 00:33:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:33:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 00:33:21 [DEBUG   ] Got command RPT from MCS: ref #272250
2018-10-26 00:33:21 [DEBUG   ] summary = ERROR
2018-10-26 00:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272250  13 58417  2001865 A  ERRORERROR'
2018-10-26 00:33:22 [DEBUG   ] Got command RPT from MCS: ref #272251
2018-10-26 00:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272251  77 58417  2002069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:33:22 [DEBUG   ] Got command RPT from MCS: ref #272252
2018-10-26 00:33:22 [DEBUG   ] summary = ERROR
2018-10-26 00:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272252  13 58417  2002273 A  ERRORERROR'
2018-10-26 00:33:22 [DEBUG   ] Got command RPT from MCS: ref #272254
2018-10-26 00:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272254  77 58417  2002465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:33:22 [DEBUG   ] Got command RPT from MCS: ref #272255
2018-10-26 00:33:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272255  12 58417  2002669 A  ERRORB ff'
2018-10-26 00:33:32 [DEBUG   ] Got command BAM from MCS: ref #272260
2018-10-26 00:33:32 [INFO    ] Finished processing BAM request
2018-10-26 00:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272260   8 58417  2012033 A  ERROR'
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:33:32 [DEBUG   ] spawn_process: at 2018-10-26 00:33:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:33:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:33:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 00:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:34:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:34:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:34:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:34:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:34:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:34:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:34:01 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-26 00:34:13 [DEBUG   ] Got command BAM from MCS: ref #272261
2018-10-26 00:34:13 [INFO    ] Finished processing BAM request
2018-10-26 00:34:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272261   8 58417  2053025 A  ERROR'
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:34:13 [DEBUG   ] spawn_process: at 2018-10-26 00:34:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:34:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:34:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:34:43 [DEBUG   ] Got command BAM from MCS: ref #272266
2018-10-26 00:34:43 [INFO    ] Finished processing BAM request
2018-10-26 00:34:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272266   8 58417  2083025 A  ERROR'
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:34:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:34:43 [DEBUG   ] spawn_process: at 2018-10-26 00:34:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:34:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:35:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:35:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:35:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:35:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:35:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:35:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:35:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:35:01 [DEBUG   ] Finished updating board flags in 1.071 seconds
2018-10-26 00:35:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:35:21 [DEBUG   ] Got command BAM from MCS: ref #272267
2018-10-26 00:35:21 [INFO    ] Finished processing BAM request
2018-10-26 00:35:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272267   8 58417  2121033 A  ERROR'
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:35:21 [DEBUG   ] spawn_process: at 2018-10-26 00:35:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:35:37 [DEBUG   ] Got command RPT from MCS: ref #272268
2018-10-26 00:35:37 [DEBUG   ] summary = ERROR
2018-10-26 00:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272268  13 58417  2137221 A  ERRORERROR'
2018-10-26 00:35:37 [DEBUG   ] Got command RPT from MCS: ref #272269
2018-10-26 00:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272269  77 58417  2137222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:35:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:35:54 [DEBUG   ] Got command BAM from MCS: ref #272285
2018-10-26 00:35:54 [INFO    ] Finished processing BAM request
2018-10-26 00:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272285   8 58417  2154025 A  ERROR'
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:35:54 [DEBUG   ] spawn_process: at 2018-10-26 00:35:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:35:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:36:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:36:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:36:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:36:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:36:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:36:02 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-26 00:36:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:36:29 [DEBUG   ] Got command BAM from MCS: ref #272286
2018-10-26 00:36:29 [INFO    ] Finished processing BAM request
2018-10-26 00:36:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272286   8 58417  2189033 A  ERROR'
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:36:29 [DEBUG   ] spawn_process: at 2018-10-26 00:36:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:36:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:36:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:37:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:37:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:37:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:37:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:37:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:37:02 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-10-26 00:37:05 [DEBUG   ] Got command BAM from MCS: ref #272287
2018-10-26 00:37:05 [INFO    ] Finished processing BAM request
2018-10-26 00:37:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272287   8 58417  2225033 A  ERROR'
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:37:05 [DEBUG   ] spawn_process: at 2018-10-26 00:37:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:37:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:37:37 [DEBUG   ] Got command BAM from MCS: ref #272288
2018-10-26 00:37:37 [INFO    ] Finished processing BAM request
2018-10-26 00:37:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272288   8 58417  2257025 A  ERROR'
2018-10-26 00:37:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:37:37 [DEBUG   ] spawn_process: at 2018-10-26 00:37:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:37:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:38:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:38:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:38:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:38:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:38:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:38:01 [DEBUG   ] Finished updating board flags in 1.253 seconds
2018-10-26 00:38:16 [DEBUG   ] Got command BAM from MCS: ref #272293
2018-10-26 00:38:16 [INFO    ] Finished processing BAM request
2018-10-26 00:38:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272293   8 58417  2296029 A  ERROR'
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:38:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:38:16 [DEBUG   ] spawn_process: at 2018-10-26 00:38:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:38:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:38:21 [DEBUG   ] Got command RPT from MCS: ref #272294
2018-10-26 00:38:21 [DEBUG   ] summary = ERROR
2018-10-26 00:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272294  13 58417  2301957 A  ERRORERROR'
2018-10-26 00:38:22 [DEBUG   ] Got command RPT from MCS: ref #272295
2018-10-26 00:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272295  77 58417  2302149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:38:22 [DEBUG   ] Got command RPT from MCS: ref #272296
2018-10-26 00:38:22 [DEBUG   ] summary = ERROR
2018-10-26 00:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272296  13 58417  2302353 A  ERRORERROR'
2018-10-26 00:38:22 [DEBUG   ] Got command RPT from MCS: ref #272297
2018-10-26 00:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272297  77 58417  2302557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:38:22 [DEBUG   ] Got command RPT from MCS: ref #272298
2018-10-26 00:38:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272298  12 58417  2302761 A  ERRORB ff'
2018-10-26 00:38:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:38:45 [DEBUG   ] Got command BAM from MCS: ref #272299
2018-10-26 00:38:45 [INFO    ] Finished processing BAM request
2018-10-26 00:38:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272299   8 58417  2325029 A  ERROR'
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:38:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:38:45 [DEBUG   ] spawn_process: at 2018-10-26 00:38:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:38:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 00:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:39:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:39:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:39:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:39:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:39:01 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-10-26 00:39:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 00:39:27 [DEBUG   ] Got command BAM from MCS: ref #272300
2018-10-26 00:39:27 [INFO    ] Finished processing BAM request
2018-10-26 00:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272300   8 58417  2367033 A  ERROR'
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:39:27 [DEBUG   ] spawn_process: at 2018-10-26 00:39:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:39:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:39:53 [DEBUG   ] Got command BAM from MCS: ref #272301
2018-10-26 00:39:53 [INFO    ] Finished processing BAM request
2018-10-26 00:39:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272301   8 58417  2393025 A  ERROR'
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:39:53 [DEBUG   ] spawn_process: at 2018-10-26 00:39:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:39:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 00:40:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:40:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:40:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:40:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:40:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:40:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:40:01 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 00:40:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 00:40:37 [DEBUG   ] Got command RPT from MCS: ref #272303
2018-10-26 00:40:37 [DEBUG   ] summary = ERROR
2018-10-26 00:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272303  13 58417  2437221 A  ERRORERROR'
2018-10-26 00:40:37 [DEBUG   ] Got command RPT from MCS: ref #272304
2018-10-26 00:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272304  77 58417  2437222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:40:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:40:38 [DEBUG   ] Got command BAM from MCS: ref #272302
2018-10-26 00:40:38 [INFO    ] Finished processing BAM request
2018-10-26 00:40:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:40:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272302   8 58417  2438029 A  ERROR'
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:40:38 [DEBUG   ] spawn_process: at 2018-10-26 00:40:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:40:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:41:01 [DEBUG   ] Got command BAM from MCS: ref #272324
2018-10-26 00:41:01 [INFO    ] Finished processing BAM request
2018-10-26 00:41:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272324   8 58417  2461029 A  ERROR'
2018-10-26 00:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:41:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 00:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:41:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:41:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:41:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:41:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:41:01 [WARNING ] (13, 1, 'bot')
2018-10-26 00:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:41:01 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:41:01 [DEBUG   ] spawn_process: at 2018-10-26 00:41:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:41:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:41:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:41:49 [DEBUG   ] Got command BAM from MCS: ref #272325
2018-10-26 00:41:49 [INFO    ] Finished processing BAM request
2018-10-26 00:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272325   8 58417  2509033 A  ERROR'
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:41:49 [DEBUG   ] spawn_process: at 2018-10-26 00:41:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:41:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 00:42:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:42:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:42:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:42:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:42:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:42:02 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-10-26 00:42:09 [DEBUG   ] Got command BAM from MCS: ref #272326
2018-10-26 00:42:09 [INFO    ] Finished processing BAM request
2018-10-26 00:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272326   8 58417  2529025 A  ERROR'
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:42:09 [DEBUG   ] spawn_process: at 2018-10-26 00:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:42:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:42:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 00:42:53 [DEBUG   ] Got command BAM from MCS: ref #272328
2018-10-26 00:42:53 [INFO    ] Finished processing BAM request
2018-10-26 00:42:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:42:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272328   8 58417  2573033 A  ERROR'
2018-10-26 00:42:53 [DEBUG   ] Got command BAM from MCS: ref #272327
2018-10-26 00:42:53 [INFO    ] Finished processing BAM request
2018-10-26 00:42:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:42:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272327   8 58417  2573037 A  ERROR'
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:42:53 [DEBUG   ] spawn_process: at 2018-10-26 00:42:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:42:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 00:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 00:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:43:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:43:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:43:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:43:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:43:02 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-10-26 00:43:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:43:22 [DEBUG   ] Got command RPT from MCS: ref #272333
2018-10-26 00:43:22 [DEBUG   ] summary = ERROR
2018-10-26 00:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272333  13 58417  2602041 A  ERRORERROR'
2018-10-26 00:43:22 [DEBUG   ] Got command RPT from MCS: ref #272334
2018-10-26 00:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272334  77 58417  2602233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:43:22 [DEBUG   ] Got command RPT from MCS: ref #272335
2018-10-26 00:43:22 [DEBUG   ] summary = ERROR
2018-10-26 00:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272335  13 58417  2602437 A  ERRORERROR'
2018-10-26 00:43:22 [DEBUG   ] Got command RPT from MCS: ref #272336
2018-10-26 00:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272336  77 58417  2602641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:43:22 [DEBUG   ] Got command RPT from MCS: ref #272338
2018-10-26 00:43:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272338  12 58417  2602845 A  ERRORBŸff'
2018-10-26 00:43:24 [DEBUG   ] Got command BAM from MCS: ref #272340
2018-10-26 00:43:24 [INFO    ] Finished processing BAM request
2018-10-26 00:43:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272340   8 58417  2604025 A  ERROR'
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:43:24 [DEBUG   ] spawn_process: at 2018-10-26 00:43:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:43:26 [DEBUG   ] Got command BAM from MCS: ref #272344
2018-10-26 00:43:26 [INFO    ] Finished processing BAM request
2018-10-26 00:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272344   8 58417  2606037 A  ERROR'
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:43:26 [DEBUG   ] spawn_process: at 2018-10-26 00:43:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:43:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:43:54 [DEBUG   ] Got command BAM from MCS: ref #272349
2018-10-26 00:43:54 [INFO    ] Finished processing BAM request
2018-10-26 00:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272349   8 58417  2634025 A  ERROR'
2018-10-26 00:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:43:54 [DEBUG   ] spawn_process: at 2018-10-26 00:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:43:55 [DEBUG   ] spawn_process: at 2018-10-26 00:43:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:43:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:43:59 [DEBUG   ] Got command BAM from MCS: ref #272350
2018-10-26 00:43:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272350   8 58417  2639029 A  ERROR'
2018-10-26 00:43:59 [INFO    ] Finished processing BAM request
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:43:59 [DEBUG   ] spawn_process: at 2018-10-26 00:43:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 00:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:44:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:44:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:44:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:44:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:44:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:44:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:44:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:44:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:44:02 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-10-26 00:44:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:44:24 [DEBUG   ] Got command BAM from MCS: ref #272351
2018-10-26 00:44:24 [INFO    ] Finished processing BAM request
2018-10-26 00:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272351   8 58417  2664029 A  ERROR'
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:44:24 [DEBUG   ] spawn_process: at 2018-10-26 00:44:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:44:32 [DEBUG   ] Got command BAM from MCS: ref #272352
2018-10-26 00:44:32 [INFO    ] Finished processing BAM request
2018-10-26 00:44:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272352   8 58417  2672029 A  ERROR'
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:44:32 [DEBUG   ] spawn_process: at 2018-10-26 00:44:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:44:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:44:53 [DEBUG   ] Got command BAM from MCS: ref #272353
2018-10-26 00:44:53 [INFO    ] Finished processing BAM request
2018-10-26 00:44:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272353   8 58417  2693025 A  ERROR'
2018-10-26 00:44:53 [DEBUG   ] Got command BAM from MCS: ref #272354
2018-10-26 00:44:53 [INFO    ] Finished processing BAM request
2018-10-26 00:44:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272354   8 58417  2693029 A  ERROR'
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:44:53 [DEBUG   ] spawn_process: at 2018-10-26 00:44:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:44:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:45:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:45:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:45:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:45:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:45:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:45:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:45:02 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-26 00:45:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:45:37 [DEBUG   ] Got command RPT from MCS: ref #272357
2018-10-26 00:45:37 [DEBUG   ] summary = ERROR
2018-10-26 00:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272357  13 58417  2737221 A  ERRORERROR'
2018-10-26 00:45:37 [DEBUG   ] Got command RPT from MCS: ref #272358
2018-10-26 00:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272358  77 58417  2737222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:45:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 00:45:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:46:01 [DEBUG   ] Got command BAM from MCS: ref #272374
2018-10-26 00:46:01 [INFO    ] Finished processing BAM request
2018-10-26 00:46:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272374   8 58417  2761033 A  ERROR'
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:46:01 [DEBUG   ] spawn_process: at 2018-10-26 00:46:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:46:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:46:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:46:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:46:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:46:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:46:02 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-10-26 00:46:04 [DEBUG   ] Got command BAM from MCS: ref #272375
2018-10-26 00:46:04 [INFO    ] Finished processing BAM request
2018-10-26 00:46:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272375   8 58417  2764033 A  ERROR'
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:46:04 [DEBUG   ] spawn_process: at 2018-10-26 00:46:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:46:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:46:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:46:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:47:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:47:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:47:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:47:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:47:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:47:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:47:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:47:02 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-10-26 00:47:09 [DEBUG   ] Got command BAM from MCS: ref #272380
2018-10-26 00:47:09 [INFO    ] Finished processing BAM request
2018-10-26 00:47:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272380   8 58417  2829029 A  ERROR'
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:47:09 [DEBUG   ] spawn_process: at 2018-10-26 00:47:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:47:15 [DEBUG   ] Got command BAM from MCS: ref #272381
2018-10-26 00:47:15 [INFO    ] Finished processing BAM request
2018-10-26 00:47:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272381   8 58417  2835025 A  ERROR'
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:47:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:47:15 [DEBUG   ] spawn_process: at 2018-10-26 00:47:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:47:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:47:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:47:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:48:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:48:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 00:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:48:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:48:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:48:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:48:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:48:02 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-26 00:48:17 [DEBUG   ] Got command BAM from MCS: ref #272382
2018-10-26 00:48:17 [INFO    ] Finished processing BAM request
2018-10-26 00:48:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272382   8 58417  2897033 A  ERROR'
2018-10-26 00:48:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:48:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:48:17 [DEBUG   ] spawn_process: at 2018-10-26 00:48:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:48:22 [DEBUG   ] Got command RPT from MCS: ref #272383
2018-10-26 00:48:22 [DEBUG   ] summary = ERROR
2018-10-26 00:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272383  13 58417  2902121 A  ERRORERROR'
2018-10-26 00:48:22 [DEBUG   ] Got command RPT from MCS: ref #272384
2018-10-26 00:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272384  77 58417  2902325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:48:22 [DEBUG   ] Got command RPT from MCS: ref #272385
2018-10-26 00:48:22 [DEBUG   ] summary = ERROR
2018-10-26 00:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272385  13 58417  2902529 A  ERRORERROR'
2018-10-26 00:48:22 [DEBUG   ] Got command RPT from MCS: ref #272386
2018-10-26 00:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272386  77 58417  2902721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:48:22 [DEBUG   ] Got command RPT from MCS: ref #272387
2018-10-26 00:48:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272387  12 58417  2902925 A  ERRORBŸff'
2018-10-26 00:48:26 [DEBUG   ] Got command BAM from MCS: ref #272388
2018-10-26 00:48:26 [INFO    ] Finished processing BAM request
2018-10-26 00:48:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272388   8 58417  2906025 A  ERROR'
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:48:26 [DEBUG   ] spawn_process: at 2018-10-26 00:48:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:48:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:48:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 00:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 00:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 00:49:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:49:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:49:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:49:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:49:02 [DEBUG   ] Finished updating board flags in 1.284 seconds
2018-10-26 00:49:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:49:25 [DEBUG   ] Got command BAM from MCS: ref #272389
2018-10-26 00:49:25 [INFO    ] Finished processing BAM request
2018-10-26 00:49:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272389   8 58417  2965025 A  ERROR'
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:49:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:49:25 [DEBUG   ] spawn_process: at 2018-10-26 00:49:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:49:37 [DEBUG   ] Got command BAM from MCS: ref #272390
2018-10-26 00:49:37 [INFO    ] Finished processing BAM request
2018-10-26 00:49:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272390   8 58417  2977033 A  ERROR'
2018-10-26 00:49:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:49:37 [DEBUG   ] spawn_process: at 2018-10-26 00:49:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:49:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:50:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:50:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:50:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:50:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:50:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:50:02 [DEBUG   ] Finished updating board flags in 1.242 seconds
2018-10-26 00:50:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:50:33 [DEBUG   ] Got command BAM from MCS: ref #272395
2018-10-26 00:50:33 [INFO    ] Finished processing BAM request
2018-10-26 00:50:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272395   8 58417  3033033 A  ERROR'
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:50:33 [DEBUG   ] spawn_process: at 2018-10-26 00:50:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:50:37 [DEBUG   ] Got command RPT from MCS: ref #272396
2018-10-26 00:50:37 [DEBUG   ] summary = ERROR
2018-10-26 00:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272396  13 58417  3037217 A  ERRORERROR'
2018-10-26 00:50:37 [DEBUG   ] Got command RPT from MCS: ref #272397
2018-10-26 00:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272397  77 58417  3037218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:50:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:50:48 [DEBUG   ] Got command BAM from MCS: ref #272413
2018-10-26 00:50:48 [INFO    ] Finished processing BAM request
2018-10-26 00:50:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272413   8 58417  3048033 A  ERROR'
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:50:48 [DEBUG   ] spawn_process: at 2018-10-26 00:50:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:50:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:51:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:51:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:51:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:51:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:51:02 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-10-26 00:51:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:51:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:51:41 [DEBUG   ] Got command BAM from MCS: ref #272414
2018-10-26 00:51:41 [INFO    ] Finished processing BAM request
2018-10-26 00:51:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272414   8 58417  3101033 A  ERROR'
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 00:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 00:51:41 [DEBUG   ] spawn_process: at 2018-10-26 00:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 00:51:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:51:59 [DEBUG   ] Got command BAM from MCS: ref #272415
2018-10-26 00:51:59 [INFO    ] Finished processing BAM request
2018-10-26 00:51:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272415   8 58417  3119029 A  ERROR'
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:51:59 [DEBUG   ] spawn_process: at 2018-10-26 00:51:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:52:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:52:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:52:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:52:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:52:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:52:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:52:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:52:02 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-10-26 00:52:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:52:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:52:49 [DEBUG   ] Got command BAM from MCS: ref #272420
2018-10-26 00:52:49 [INFO    ] Finished processing BAM request
2018-10-26 00:52:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:52:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272420   8 58417  3169029 A  ERROR'
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:52:49 [DEBUG   ] spawn_process: at 2018-10-26 00:52:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:52:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:53:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:53:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:53:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:53:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:53:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:53:02 [WARNING ] (13, 1, 'bot')
2018-10-26 00:53:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:53:02 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-10-26 00:53:10 [DEBUG   ] Got command BAM from MCS: ref #272423
2018-10-26 00:53:10 [INFO    ] Finished processing BAM request
2018-10-26 00:53:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272423   8 58417  3190025 A  ERROR'
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:53:10 [DEBUG   ] spawn_process: at 2018-10-26 00:53:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:53:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:53:22 [DEBUG   ] Got command RPT from MCS: ref #272424
2018-10-26 00:53:22 [DEBUG   ] summary = ERROR
2018-10-26 00:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272424  13 58417  3202209 A  ERRORERROR'
2018-10-26 00:53:22 [DEBUG   ] Got command RPT from MCS: ref #272425
2018-10-26 00:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272425  77 58417  3202413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:53:22 [DEBUG   ] Got command RPT from MCS: ref #272426
2018-10-26 00:53:22 [DEBUG   ] summary = ERROR
2018-10-26 00:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272426  13 58417  3202605 A  ERRORERROR'
2018-10-26 00:53:22 [DEBUG   ] Got command RPT from MCS: ref #272428
2018-10-26 00:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272428  77 58417  3202809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:53:23 [DEBUG   ] Got command RPT from MCS: ref #272429
2018-10-26 00:53:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272429  12 58417  3203013 A  ERRORB ff'
2018-10-26 00:53:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:53:57 [DEBUG   ] Got command BAM from MCS: ref #272434
2018-10-26 00:53:57 [INFO    ] Finished processing BAM request
2018-10-26 00:53:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272434   8 58417  3237025 A  ERROR'
2018-10-26 00:53:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:53:57 [DEBUG   ] spawn_process: at 2018-10-26 00:53:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:54:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:54:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 00:54:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:54:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:54:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:54:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:54:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:54:03 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-26 00:54:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:54:21 [DEBUG   ] Got command BAM from MCS: ref #272435
2018-10-26 00:54:21 [INFO    ] Finished processing BAM request
2018-10-26 00:54:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272435   8 58417  3261025 A  ERROR'
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:54:21 [DEBUG   ] spawn_process: at 2018-10-26 00:54:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:54:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:54:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:55:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:55:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 00:55:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:55:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:55:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:55:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:55:03 [DEBUG   ] Finished updating board flags in 1.289 seconds
2018-10-26 00:55:05 [DEBUG   ] Got command BAM from MCS: ref #272436
2018-10-26 00:55:05 [INFO    ] Finished processing BAM request
2018-10-26 00:55:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272436   8 58417  3305029 A  ERROR'
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:55:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:55:05 [DEBUG   ] spawn_process: at 2018-10-26 00:55:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:55:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:55:32 [DEBUG   ] Got command BAM from MCS: ref #272437
2018-10-26 00:55:32 [INFO    ] Finished processing BAM request
2018-10-26 00:55:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272437   8 58417  3332029 A  ERROR'
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:55:32 [DEBUG   ] spawn_process: at 2018-10-26 00:55:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:55:37 [DEBUG   ] Got command RPT from MCS: ref #272438
2018-10-26 00:55:37 [DEBUG   ] summary = ERROR
2018-10-26 00:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272438  13 58417  3337217 A  ERRORERROR'
2018-10-26 00:55:37 [DEBUG   ] Got command RPT from MCS: ref #272439
2018-10-26 00:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272439  77 58417  3337218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:55:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:55:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:56:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:56:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:56:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:56:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:56:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:56:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:56:03 [DEBUG   ] Finished updating board flags in 1.115 seconds
2018-10-26 00:56:13 [DEBUG   ] Got command BAM from MCS: ref #272459
2018-10-26 00:56:13 [INFO    ] Finished processing BAM request
2018-10-26 00:56:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272459   8 58417  3373029 A  ERROR'
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:56:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:56:13 [DEBUG   ] spawn_process: at 2018-10-26 00:56:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:56:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:56:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:56:43 [DEBUG   ] Got command BAM from MCS: ref #272460
2018-10-26 00:56:43 [INFO    ] Finished processing BAM request
2018-10-26 00:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272460   8 58417  3403033 A  ERROR'
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 00:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 00:56:43 [DEBUG   ] spawn_process: at 2018-10-26 00:56:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 00:56:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 00:57:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 00:57:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:57:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 00:57:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:57:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:57:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:57:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:57:03 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-10-26 00:57:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 00:57:21 [DEBUG   ] Got command BAM from MCS: ref #272461
2018-10-26 00:57:21 [INFO    ] Finished processing BAM request
2018-10-26 00:57:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272461   8 58417  3441025 A  ERROR'
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:57:21 [DEBUG   ] spawn_process: at 2018-10-26 00:57:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:57:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:57:54 [DEBUG   ] Got command BAM from MCS: ref #272462
2018-10-26 00:57:54 [INFO    ] Finished processing BAM request
2018-10-26 00:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272462   8 58417  3474025 A  ERROR'
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:57:54 [DEBUG   ] spawn_process: at 2018-10-26 00:57:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:57:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:58:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 00:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 00:58:04 [WARNING ] (13, 1, 'bot')
2018-10-26 00:58:04 [WARNING ] (13, 1, 'bot')
2018-10-26 00:58:04 [WARNING ] (13, 1, 'bot')
2018-10-26 00:58:04 [WARNING ] (13, 1, 'bot')
2018-10-26 00:58:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:58:04 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-26 00:58:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:58:22 [DEBUG   ] Got command RPT from MCS: ref #272463
2018-10-26 00:58:22 [DEBUG   ] summary = ERROR
2018-10-26 00:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272463  13 58417  3502297 A  ERRORERROR'
2018-10-26 00:58:22 [DEBUG   ] Got command RPT from MCS: ref #272464
2018-10-26 00:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272464  77 58417  3502501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:58:22 [DEBUG   ] Got command RPT from MCS: ref #272465
2018-10-26 00:58:22 [DEBUG   ] summary = ERROR
2018-10-26 00:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272465  13 58417  3502693 A  ERRORERROR'
2018-10-26 00:58:22 [DEBUG   ] Got command RPT from MCS: ref #272466
2018-10-26 00:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 00:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272466  77 58417  3502897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 00:58:23 [DEBUG   ] Got command RPT from MCS: ref #272467
2018-10-26 00:58:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 00:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272467  12 58417  3503101 A  ERRORBŸff'
2018-10-26 00:58:29 [DEBUG   ] Got command BAM from MCS: ref #272468
2018-10-26 00:58:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272468   8 58417  3509033 A  ERROR'
2018-10-26 00:58:29 [INFO    ] Finished processing BAM request
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 00:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 00:58:29 [DEBUG   ] spawn_process: at 2018-10-26 00:58:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 00:58:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:58:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:59:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 00:59:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 00:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 00:59:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 00:59:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:59:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:59:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:59:03 [WARNING ] (13, 1, 'bot')
2018-10-26 00:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 00:59:03 [DEBUG   ] Finished updating board flags in 1.240 seconds
2018-10-26 00:59:05 [DEBUG   ] Got command BAM from MCS: ref #272473
2018-10-26 00:59:05 [INFO    ] Finished processing BAM request
2018-10-26 00:59:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272473   8 58417  3545029 A  ERROR'
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 00:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 00:59:05 [DEBUG   ] spawn_process: at 2018-10-26 00:59:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 00:59:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:59:37 [DEBUG   ] Got command BAM from MCS: ref #272474
2018-10-26 00:59:37 [INFO    ] Finished processing BAM request
2018-10-26 00:59:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 00:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272474   8 58417  3577025 A  ERROR'
2018-10-26 00:59:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 00:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 00:59:37 [DEBUG   ] spawn_process: at 2018-10-26 00:59:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 00:59:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:00:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:00:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:00:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:00:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:00:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:00:03 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-10-26 01:00:16 [DEBUG   ] Got command BAM from MCS: ref #272475
2018-10-26 01:00:16 [INFO    ] Finished processing BAM request
2018-10-26 01:00:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272475   8 58417  3616025 A  ERROR'
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:00:16 [DEBUG   ] spawn_process: at 2018-10-26 01:00:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:00:17 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 01:00:37 [DEBUG   ] Got command RPT from MCS: ref #272476
2018-10-26 01:00:37 [DEBUG   ] summary = ERROR
2018-10-26 01:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272476  13 58417  3637229 A  ERRORERROR'
2018-10-26 01:00:37 [DEBUG   ] Got command RPT from MCS: ref #272477
2018-10-26 01:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272477  77 58417  3637230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:00:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:00:45 [DEBUG   ] Got command BAM from MCS: ref #272493
2018-10-26 01:00:45 [INFO    ] Finished processing BAM request
2018-10-26 01:00:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272493   8 58417  3645025 A  ERROR'
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:00:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:00:45 [DEBUG   ] spawn_process: at 2018-10-26 01:00:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:00:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:01:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 01:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:01:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:01:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:01:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:01:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:01:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:01:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:01:03 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-10-26 01:01:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:01:27 [DEBUG   ] Got command BAM from MCS: ref #272494
2018-10-26 01:01:27 [INFO    ] Finished processing BAM request
2018-10-26 01:01:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272494   8 58417  3687029 A  ERROR'
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:01:27 [DEBUG   ] spawn_process: at 2018-10-26 01:01:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:01:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:01:53 [DEBUG   ] Got command BAM from MCS: ref #272499
2018-10-26 01:01:53 [INFO    ] Finished processing BAM request
2018-10-26 01:01:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272499   8 58417  3713034 A  ERROR'
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:01:53 [DEBUG   ] spawn_process: at 2018-10-26 01:01:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:01:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:02:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:02:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:02:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:02:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:02:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:02:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:02:03 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-10-26 01:02:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:02:38 [DEBUG   ] Got command BAM from MCS: ref #272500
2018-10-26 01:02:38 [INFO    ] Finished processing BAM request
2018-10-26 01:02:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272500   8 58417  3758029 A  ERROR'
2018-10-26 01:02:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:02:38 [DEBUG   ] spawn_process: at 2018-10-26 01:02:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:02:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:03:01 [DEBUG   ] Got command BAM from MCS: ref #272503
2018-10-26 01:03:01 [INFO    ] Finished processing BAM request
2018-10-26 01:03:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:03:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272503   8 58417  3781033 A  ERROR'
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:03:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:03:01 [DEBUG   ] spawn_process: at 2018-10-26 01:03:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:03:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:03:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:03:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:03:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:03:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:03:03 [WARNING ] (13, 1, 'bot')
2018-10-26 01:03:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:03:03 [DEBUG   ] Finished updating board flags in 0.978 seconds
2018-10-26 01:03:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:03:22 [DEBUG   ] Got command RPT from MCS: ref #272504
2018-10-26 01:03:22 [DEBUG   ] summary = ERROR
2018-10-26 01:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272504  13 58417  3802385 A  ERRORERROR'
2018-10-26 01:03:22 [DEBUG   ] Got command RPT from MCS: ref #272505
2018-10-26 01:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272505  77 58417  3802577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:03:22 [DEBUG   ] Got command RPT from MCS: ref #272506
2018-10-26 01:03:22 [DEBUG   ] summary = ERROR
2018-10-26 01:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272506  13 58417  3802781 A  ERRORERROR'
2018-10-26 01:03:22 [DEBUG   ] Got command RPT from MCS: ref #272508
2018-10-26 01:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272508  77 58417  3802985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:03:23 [DEBUG   ] Got command RPT from MCS: ref #272510
2018-10-26 01:03:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272510  12 58417  3803189 A  ERRORB ff'
2018-10-26 01:03:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:03:49 [DEBUG   ] Got command BAM from MCS: ref #272514
2018-10-26 01:03:49 [INFO    ] Finished processing BAM request
2018-10-26 01:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272514   8 58417  3829049 A  ERROR'
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:03:49 [DEBUG   ] spawn_process: at 2018-10-26 01:03:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:03:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:04:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 01:04:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:04:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:04:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:04:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:04:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:04:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:04:04 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-10-26 01:04:09 [DEBUG   ] Got command BAM from MCS: ref #272515
2018-10-26 01:04:09 [INFO    ] Finished processing BAM request
2018-10-26 01:04:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272515   8 58417  3849033 A  ERROR'
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:04:09 [DEBUG   ] spawn_process: at 2018-10-26 01:04:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:04:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:04:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:04:53 [DEBUG   ] Got command BAM from MCS: ref #272520
2018-10-26 01:04:53 [INFO    ] Finished processing BAM request
2018-10-26 01:04:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272520   8 58417  3893033 A  ERROR'
2018-10-26 01:04:53 [DEBUG   ] Got command BAM from MCS: ref #272521
2018-10-26 01:04:53 [INFO    ] Finished processing BAM request
2018-10-26 01:04:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272521   8 58417  3893037 A  ERROR'
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:04:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:04:53 [DEBUG   ] spawn_process: at 2018-10-26 01:04:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:04:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:05:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 01:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:05:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:05:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:05:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:05:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:05:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:05:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:05:04 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-26 01:05:18 [DEBUG   ] Got command BAM from MCS: ref #272524
2018-10-26 01:05:18 [INFO    ] Finished processing BAM request
2018-10-26 01:05:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272524   8 58417  3918029 A  ERROR'
2018-10-26 01:05:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:05:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:05:18 [DEBUG   ] spawn_process: at 2018-10-26 01:05:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:05:22 [DEBUG   ] Got command BAM from MCS: ref #272525
2018-10-26 01:05:22 [INFO    ] Finished processing BAM request
2018-10-26 01:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272525   8 58417  3922025 A  ERROR'
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:05:22 [DEBUG   ] spawn_process: at 2018-10-26 01:05:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:05:37 [DEBUG   ] Got command RPT from MCS: ref #272526
2018-10-26 01:05:37 [DEBUG   ] summary = ERROR
2018-10-26 01:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272526  13 58417  3937229 A  ERRORERROR'
2018-10-26 01:05:37 [DEBUG   ] Got command RPT from MCS: ref #272527
2018-10-26 01:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272527  77 58417  3937230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:05:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:05:43 [DEBUG   ] Got command BAM from MCS: ref #272543
2018-10-26 01:05:43 [INFO    ] Finished processing BAM request
2018-10-26 01:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272543   8 58417  3943029 A  ERROR'
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:05:43 [DEBUG   ] spawn_process: at 2018-10-26 01:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:05:51 [DEBUG   ] Got command BAM from MCS: ref #272544
2018-10-26 01:05:51 [INFO    ] Finished processing BAM request
2018-10-26 01:05:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:05:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272544   8 58417  3951025 A  ERROR'
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:05:51 [DEBUG   ] spawn_process: at 2018-10-26 01:05:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:05:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:06:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 01:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:06:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:06:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:06:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:06:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:06:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:06:04 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-10-26 01:06:08 [DEBUG   ] Got command BAM from MCS: ref #272545
2018-10-26 01:06:08 [INFO    ] Finished processing BAM request
2018-10-26 01:06:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272545   8 58417  3968025 A  ERROR'
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:06:08 [DEBUG   ] spawn_process: at 2018-10-26 01:06:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:06:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:06:20 [DEBUG   ] Got command BAM from MCS: ref #272546
2018-10-26 01:06:20 [INFO    ] Finished processing BAM request
2018-10-26 01:06:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272546   8 58417  3980029 A  ERROR'
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:06:20 [DEBUG   ] spawn_process: at 2018-10-26 01:06:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:06:33 [DEBUG   ] Got command BAM from MCS: ref #272547
2018-10-26 01:06:33 [INFO    ] Finished processing BAM request
2018-10-26 01:06:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272547   8 58417  3993029 A  ERROR'
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:06:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:06:33 [DEBUG   ] spawn_process: at 2018-10-26 01:06:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:06:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 01:06:49 [DEBUG   ] Got command BAM from MCS: ref #272548
2018-10-26 01:06:49 [INFO    ] Finished processing BAM request
2018-10-26 01:06:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272548   8 58417  4009041 A  ERROR'
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:06:49 [DEBUG   ] spawn_process: at 2018-10-26 01:06:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:06:53 [DEBUG   ] Got command BAM from MCS: ref #272550
2018-10-26 01:06:53 [INFO    ] Finished processing BAM request
2018-10-26 01:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272550   8 58417  4013025 A  ERROR'
2018-10-26 01:06:53 [DEBUG   ] Got command BAM from MCS: ref #272549
2018-10-26 01:06:53 [INFO    ] Finished processing BAM request
2018-10-26 01:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272549   8 58417  4013029 A  ERROR'
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:06:53 [DEBUG   ] spawn_process: at 2018-10-26 01:06:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:06:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:07:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:07:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:07:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:07:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:07:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:07:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:07:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:07:04 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-10-26 01:07:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 01:07:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:07:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:08:01 [DEBUG   ] Got command BAM from MCS: ref #272557
2018-10-26 01:08:01 [INFO    ] Finished processing BAM request
2018-10-26 01:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272557   8 58417  4081033 A  ERROR'
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:08:01 [DEBUG   ] spawn_process: at 2018-10-26 01:08:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:08:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:08:04 [DEBUG   ] Got command BAM from MCS: ref #272558
2018-10-26 01:08:04 [INFO    ] Finished processing BAM request
2018-10-26 01:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272558   8 58417  4084025 A  ERROR'
2018-10-26 01:08:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:08:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:08:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:08:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:08:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:08:04 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:08:04 [DEBUG   ] spawn_process: at 2018-10-26 01:08:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:08:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:08:22 [DEBUG   ] Got command RPT from MCS: ref #272559
2018-10-26 01:08:22 [DEBUG   ] summary = ERROR
2018-10-26 01:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272559  13 58417  4102469 A  ERRORERROR'
2018-10-26 01:08:22 [DEBUG   ] Got command RPT from MCS: ref #272560
2018-10-26 01:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272560  77 58417  4102673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:08:22 [DEBUG   ] Got command RPT from MCS: ref #272561
2018-10-26 01:08:22 [DEBUG   ] summary = ERROR
2018-10-26 01:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272561  13 58417  4102865 A  ERRORERROR'
2018-10-26 01:08:23 [DEBUG   ] Got command RPT from MCS: ref #272562
2018-10-26 01:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272562  77 58417  4103069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:08:23 [DEBUG   ] Got command RPT from MCS: ref #272563
2018-10-26 01:08:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272563  12 58417  4103273 A  ERRORB ff'
2018-10-26 01:08:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:08:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:09:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:09:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:09:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:09:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:09:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:09:05 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-26 01:09:09 [DEBUG   ] Got command BAM from MCS: ref #272564
2018-10-26 01:09:09 [INFO    ] Finished processing BAM request
2018-10-26 01:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272564   8 58417  4149025 A  ERROR'
2018-10-26 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:09:09 [DEBUG   ] spawn_process: at 2018-10-26 01:09:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:09:10 [DEBUG   ] spawn_process: at 2018-10-26 01:09:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:09:15 [DEBUG   ] Got command BAM from MCS: ref #272565
2018-10-26 01:09:15 [INFO    ] Finished processing BAM request
2018-10-26 01:09:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272565   8 58417  4155029 A  ERROR'
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:09:15 [DEBUG   ] spawn_process: at 2018-10-26 01:09:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:09:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:09:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:09:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 01:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 01:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:10:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:10:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:10:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:10:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:10:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:10:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:10:05 [DEBUG   ] Finished updating board flags in 1.853 seconds
2018-10-26 01:10:17 [DEBUG   ] Got command BAM from MCS: ref #272566
2018-10-26 01:10:17 [INFO    ] Finished processing BAM request
2018-10-26 01:10:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272566   8 58417  4217029 A  ERROR'
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:10:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:10:17 [DEBUG   ] spawn_process: at 2018-10-26 01:10:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:10:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 01:10:26 [DEBUG   ] Got command BAM from MCS: ref #272567
2018-10-26 01:10:26 [INFO    ] Finished processing BAM request
2018-10-26 01:10:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272567   8 58417  4226033 A  ERROR'
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:10:26 [DEBUG   ] spawn_process: at 2018-10-26 01:10:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:10:37 [DEBUG   ] Got command RPT from MCS: ref #272568
2018-10-26 01:10:37 [DEBUG   ] summary = ERROR
2018-10-26 01:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272568  13 58417  4237225 A  ERRORERROR'
2018-10-26 01:10:37 [DEBUG   ] Got command RPT from MCS: ref #272569
2018-10-26 01:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272569  77 58417  4237226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:10:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:10:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:11:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:11:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:11:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:11:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:11:04 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-10-26 01:11:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:11:25 [DEBUG   ] Got command BAM from MCS: ref #272589
2018-10-26 01:11:25 [INFO    ] Finished processing BAM request
2018-10-26 01:11:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272589   8 58417  4285033 A  ERROR'
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:11:25 [DEBUG   ] spawn_process: at 2018-10-26 01:11:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:11:37 [DEBUG   ] Got command BAM from MCS: ref #272590
2018-10-26 01:11:37 [INFO    ] Finished processing BAM request
2018-10-26 01:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272590   8 58417  4297029 A  ERROR'
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:11:37 [DEBUG   ] spawn_process: at 2018-10-26 01:11:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:11:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:11:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:12:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 01:12:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:12:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:12:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:12:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:12:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:12:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:12:04 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-26 01:12:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:12:33 [DEBUG   ] Got command BAM from MCS: ref #272591
2018-10-26 01:12:33 [INFO    ] Finished processing BAM request
2018-10-26 01:12:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272591   8 58417  4353025 A  ERROR'
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:12:33 [DEBUG   ] spawn_process: at 2018-10-26 01:12:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:12:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:12:48 [DEBUG   ] Got command BAM from MCS: ref #272592
2018-10-26 01:12:48 [INFO    ] Finished processing BAM request
2018-10-26 01:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272592   8 58417  4368029 A  ERROR'
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:12:48 [DEBUG   ] spawn_process: at 2018-10-26 01:12:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:12:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:13:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:13:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:13:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:13:04 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-10-26 01:13:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:13:22 [DEBUG   ] Got command RPT from MCS: ref #272595
2018-10-26 01:13:22 [DEBUG   ] summary = ERROR
2018-10-26 01:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272595  13 58417  4402545 A  ERRORERROR'
2018-10-26 01:13:22 [DEBUG   ] Got command RPT from MCS: ref #272596
2018-10-26 01:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272596  77 58417  4402749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:13:22 [DEBUG   ] Got command RPT from MCS: ref #272597
2018-10-26 01:13:22 [DEBUG   ] summary = ERROR
2018-10-26 01:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272597  13 58417  4402953 A  ERRORERROR'
2018-10-26 01:13:23 [DEBUG   ] Got command RPT from MCS: ref #272599
2018-10-26 01:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272599  77 58417  4403157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:13:23 [DEBUG   ] Got command RPT from MCS: ref #272601
2018-10-26 01:13:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272601  12 58417  4403349 A  ERRORB ff'
2018-10-26 01:13:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:13:41 [DEBUG   ] Got command BAM from MCS: ref #272609
2018-10-26 01:13:41 [INFO    ] Finished processing BAM request
2018-10-26 01:13:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272609   8 58417  4421029 A  ERROR'
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:13:41 [DEBUG   ] spawn_process: at 2018-10-26 01:13:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:13:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:14:00 [DEBUG   ] Got command BAM from MCS: ref #272610
2018-10-26 01:14:00 [INFO    ] Finished processing BAM request
2018-10-26 01:14:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272610   8 58417  4440025 A  ERROR'
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:14:00 [DEBUG   ] spawn_process: at 2018-10-26 01:14:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:14:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:14:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:14:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:14:04 [WARNING ] (13, 1, 'bot')
2018-10-26 01:14:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:14:04 [DEBUG   ] Finished updating board flags in 0.948 seconds
2018-10-26 01:14:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:14:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:14:49 [DEBUG   ] Got command BAM from MCS: ref #272611
2018-10-26 01:14:49 [INFO    ] Finished processing BAM request
2018-10-26 01:14:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272611   8 58417  4489037 A  ERROR'
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:14:49 [DEBUG   ] spawn_process: at 2018-10-26 01:14:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:14:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:15:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:15:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:15:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:15:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:15:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:15:05 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-10-26 01:15:12 [DEBUG   ] Got command BAM from MCS: ref #272612
2018-10-26 01:15:12 [INFO    ] Finished processing BAM request
2018-10-26 01:15:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272612   8 58417  4512029 A  ERROR'
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:15:12 [DEBUG   ] spawn_process: at 2018-10-26 01:15:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:15:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:15:37 [DEBUG   ] Got command RPT from MCS: ref #272613
2018-10-26 01:15:37 [DEBUG   ] summary = ERROR
2018-10-26 01:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272613  13 58417  4537233 A  ERRORERROR'
2018-10-26 01:15:37 [DEBUG   ] Got command RPT from MCS: ref #272614
2018-10-26 01:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272614  77 58417  4537234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:15:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:15:57 [DEBUG   ] Got command BAM from MCS: ref #272630
2018-10-26 01:15:57 [INFO    ] Finished processing BAM request
2018-10-26 01:15:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272630   8 58417  4557029 A  ERROR'
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:15:57 [DEBUG   ] spawn_process: at 2018-10-26 01:15:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:15:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:16:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:16:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 01:16:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:16:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:16:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:16:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:16:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:16:05 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-10-26 01:16:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:16:24 [DEBUG   ] Got command BAM from MCS: ref #272631
2018-10-26 01:16:24 [INFO    ] Finished processing BAM request
2018-10-26 01:16:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:16:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272631   8 58417  4584029 A  ERROR'
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:16:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:16:24 [DEBUG   ] spawn_process: at 2018-10-26 01:16:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:16:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:16:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:17:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:17:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:17:05 [DEBUG   ] Got command BAM from MCS: ref #272636
2018-10-26 01:17:05 [INFO    ] Finished processing BAM request
2018-10-26 01:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272636   8 58417  4625029 A  ERROR'
2018-10-26 01:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 01:17:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:17:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:17:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:17:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:17:05 [DEBUG   ] Finished updating board flags in 1.244 seconds
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:17:05 [DEBUG   ] spawn_process: at 2018-10-26 01:17:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:17:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:17:36 [DEBUG   ] Got command BAM from MCS: ref #272637
2018-10-26 01:17:36 [INFO    ] Finished processing BAM request
2018-10-26 01:17:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272637   8 58417  4656025 A  ERROR'
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:17:36 [DEBUG   ] spawn_process: at 2018-10-26 01:17:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:17:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:17:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:18:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:18:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:18:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:18:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:18:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:18:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:18:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:18:05 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-10-26 01:18:13 [DEBUG   ] Got command BAM from MCS: ref #272638
2018-10-26 01:18:13 [INFO    ] Finished processing BAM request
2018-10-26 01:18:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272638   8 58417  4693033 A  ERROR'
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:18:13 [DEBUG   ] spawn_process: at 2018-10-26 01:18:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:18:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:18:22 [DEBUG   ] Got command RPT from MCS: ref #272639
2018-10-26 01:18:22 [DEBUG   ] summary = ERROR
2018-10-26 01:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272639  13 58417  4702633 A  ERRORERROR'
2018-10-26 01:18:22 [DEBUG   ] Got command RPT from MCS: ref #272640
2018-10-26 01:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272640  77 58417  4702837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:18:23 [DEBUG   ] Got command RPT from MCS: ref #272641
2018-10-26 01:18:23 [DEBUG   ] summary = ERROR
2018-10-26 01:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272641  13 58417  4703041 A  ERRORERROR'
2018-10-26 01:18:23 [DEBUG   ] Got command RPT from MCS: ref #272642
2018-10-26 01:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272642  77 58417  4703233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:18:23 [DEBUG   ] Got command RPT from MCS: ref #272643
2018-10-26 01:18:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272643  12 58417  4703437 A  ERRORB ff'
2018-10-26 01:18:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:18:48 [DEBUG   ] Got command BAM from MCS: ref #272644
2018-10-26 01:18:48 [INFO    ] Finished processing BAM request
2018-10-26 01:18:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272644   8 58417  4728033 A  ERROR'
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:18:48 [DEBUG   ] spawn_process: at 2018-10-26 01:18:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:18:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:19:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:19:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:19:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:19:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:19:06 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-26 01:19:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:19:21 [DEBUG   ] Got command BAM from MCS: ref #272645
2018-10-26 01:19:21 [INFO    ] Finished processing BAM request
2018-10-26 01:19:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272645   8 58417  4761029 A  ERROR'
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:19:21 [DEBUG   ] spawn_process: at 2018-10-26 01:19:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:19:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 01:19:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:20:00 [DEBUG   ] Got command BAM from MCS: ref #272650
2018-10-26 01:20:00 [INFO    ] Finished processing BAM request
2018-10-26 01:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272650   8 58417  4800025 A  ERROR'
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:20:00 [DEBUG   ] spawn_process: at 2018-10-26 01:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:20:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:20:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:20:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:20:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:20:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:20:06 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-10-26 01:20:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 01:20:29 [DEBUG   ] Got command BAM from MCS: ref #272651
2018-10-26 01:20:29 [INFO    ] Finished processing BAM request
2018-10-26 01:20:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272651   8 58417  4829033 A  ERROR'
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:20:29 [DEBUG   ] spawn_process: at 2018-10-26 01:20:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:20:37 [DEBUG   ] Got command RPT from MCS: ref #272652
2018-10-26 01:20:37 [DEBUG   ] summary = ERROR
2018-10-26 01:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272652  13 58417  4837229 A  ERRORERROR'
2018-10-26 01:20:37 [DEBUG   ] Got command RPT from MCS: ref #272653
2018-10-26 01:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272653  77 58417  4837230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:20:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:20:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:21:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:21:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:21:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:21:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:21:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:21:05 [DEBUG   ] Finished updating board flags in 1.257 seconds
2018-10-26 01:21:12 [DEBUG   ] Got command BAM from MCS: ref #272669
2018-10-26 01:21:12 [INFO    ] Finished processing BAM request
2018-10-26 01:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272669   8 58417  4872029 A  ERROR'
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:21:12 [DEBUG   ] spawn_process: at 2018-10-26 01:21:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:21:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:21:37 [DEBUG   ] Got command BAM from MCS: ref #272670
2018-10-26 01:21:37 [INFO    ] Finished processing BAM request
2018-10-26 01:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272670   8 58417  4897033 A  ERROR'
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:21:37 [DEBUG   ] spawn_process: at 2018-10-26 01:21:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:21:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:21:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:22:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:22:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:22:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:22:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:22:05 [DEBUG   ] Finished updating board flags in 1.231 seconds
2018-10-26 01:22:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:22:24 [DEBUG   ] Got command BAM from MCS: ref #272671
2018-10-26 01:22:24 [INFO    ] Finished processing BAM request
2018-10-26 01:22:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272671   8 58417  4944033 A  ERROR'
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:22:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:22:24 [DEBUG   ] spawn_process: at 2018-10-26 01:22:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:22:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:22:45 [DEBUG   ] Got command BAM from MCS: ref #272676
2018-10-26 01:22:45 [INFO    ] Finished processing BAM request
2018-10-26 01:22:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:22:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272676   8 58417  4965033 A  ERROR'
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:22:45 [DEBUG   ] spawn_process: at 2018-10-26 01:22:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:22:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:23:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:23:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:23:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:23:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:23:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:23:05 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-26 01:23:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:23:22 [DEBUG   ] Got command RPT from MCS: ref #272679
2018-10-26 01:23:22 [DEBUG   ] summary = ERROR
2018-10-26 01:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272679  13 58417  5002725 A  ERRORERROR'
2018-10-26 01:23:22 [DEBUG   ] Got command RPT from MCS: ref #272680
2018-10-26 01:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272680  77 58417  5002917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:23:23 [DEBUG   ] Got command RPT from MCS: ref #272681
2018-10-26 01:23:23 [DEBUG   ] summary = ERROR
2018-10-26 01:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272681  13 58417  5003121 A  ERRORERROR'
2018-10-26 01:23:23 [DEBUG   ] Got command RPT from MCS: ref #272683
2018-10-26 01:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272683  77 58417  5003325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:23:23 [DEBUG   ] Got command RPT from MCS: ref #272684
2018-10-26 01:23:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272684  12 58417  5003529 A  ERRORBŸff'
2018-10-26 01:23:36 [DEBUG   ] Got command BAM from MCS: ref #272689
2018-10-26 01:23:36 [INFO    ] Finished processing BAM request
2018-10-26 01:23:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272689   8 58417  5016025 A  ERROR'
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:23:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:23:36 [DEBUG   ] spawn_process: at 2018-10-26 01:23:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:23:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:23:53 [DEBUG   ] Got command BAM from MCS: ref #272690
2018-10-26 01:23:53 [INFO    ] Finished processing BAM request
2018-10-26 01:23:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272690   8 58417  5033033 A  ERROR'
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:23:53 [DEBUG   ] spawn_process: at 2018-10-26 01:23:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:23:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:24:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:24:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:24:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:24:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:24:06 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-10-26 01:24:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:24:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:24:48 [DEBUG   ] Got command BAM from MCS: ref #272691
2018-10-26 01:24:48 [INFO    ] Finished processing BAM request
2018-10-26 01:24:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272691   8 58417  5088033 A  ERROR'
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:24:48 [DEBUG   ] spawn_process: at 2018-10-26 01:24:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:24:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:25:02 [DEBUG   ] Got command BAM from MCS: ref #272692
2018-10-26 01:25:02 [INFO    ] Finished processing BAM request
2018-10-26 01:25:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272692   8 58417  5102025 A  ERROR'
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:25:02 [DEBUG   ] spawn_process: at 2018-10-26 01:25:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 01:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:25:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 01:25:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:25:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:25:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:25:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:25:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:25:05 [DEBUG   ] Finished updating board flags in 1.143 seconds
2018-10-26 01:25:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:25:37 [DEBUG   ] Got command RPT from MCS: ref #272693
2018-10-26 01:25:37 [DEBUG   ] summary = ERROR
2018-10-26 01:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272693  13 58417  5137229 A  ERRORERROR'
2018-10-26 01:25:37 [DEBUG   ] Got command RPT from MCS: ref #272694
2018-10-26 01:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272694  77 58417  5137230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:25:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:25:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:26:00 [DEBUG   ] Got command BAM from MCS: ref #272714
2018-10-26 01:26:00 [INFO    ] Finished processing BAM request
2018-10-26 01:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272714   8 58417  5160025 A  ERROR'
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:26:00 [DEBUG   ] spawn_process: at 2018-10-26 01:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:26:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 01:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 01:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:26:05 [DEBUG   ] Finished updating board flags in 1.029 seconds
2018-10-26 01:26:11 [DEBUG   ] Got command BAM from MCS: ref #272715
2018-10-26 01:26:11 [INFO    ] Finished processing BAM request
2018-10-26 01:26:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272715   8 58417  5171033 A  ERROR'
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:26:11 [DEBUG   ] spawn_process: at 2018-10-26 01:26:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:26:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:26:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:26:53 [DEBUG   ] Got command BAM from MCS: ref #272716
2018-10-26 01:26:53 [INFO    ] Finished processing BAM request
2018-10-26 01:26:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272716   8 58417  5213029 A  ERROR'
2018-10-26 01:26:53 [DEBUG   ] Got command BAM from MCS: ref #272717
2018-10-26 01:26:53 [INFO    ] Finished processing BAM request
2018-10-26 01:26:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272717   8 58417  5213033 A  ERROR'
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:26:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:26:53 [DEBUG   ] spawn_process: at 2018-10-26 01:26:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:26:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:27:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:27:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:27:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:27:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:27:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:27:06 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-26 01:27:16 [DEBUG   ] Got command BAM from MCS: ref #272720
2018-10-26 01:27:16 [INFO    ] Finished processing BAM request
2018-10-26 01:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272720   8 58417  5236033 A  ERROR'
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:27:16 [DEBUG   ] spawn_process: at 2018-10-26 01:27:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:27:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 01:27:21 [DEBUG   ] Got command BAM from MCS: ref #272721
2018-10-26 01:27:21 [INFO    ] Finished processing BAM request
2018-10-26 01:27:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272721   8 58417  5241033 A  ERROR'
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:27:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:27:21 [DEBUG   ] spawn_process: at 2018-10-26 01:27:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:27:39 [DEBUG   ] Got command BAM from MCS: ref #272722
2018-10-26 01:27:39 [INFO    ] Finished processing BAM request
2018-10-26 01:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272722   8 58417  5259033 A  ERROR'
2018-10-26 01:27:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:27:39 [DEBUG   ] spawn_process: at 2018-10-26 01:27:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:27:49 [DEBUG   ] Got command BAM from MCS: ref #272723
2018-10-26 01:27:49 [INFO    ] Finished processing BAM request
2018-10-26 01:27:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:27:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272723   8 58417  5269033 A  ERROR'
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:27:49 [DEBUG   ] spawn_process: at 2018-10-26 01:27:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:27:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:28:02 [DEBUG   ] Got command BAM from MCS: ref #272724
2018-10-26 01:28:02 [INFO    ] Finished processing BAM request
2018-10-26 01:28:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272724   8 58417  5282029 A  ERROR'
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:28:02 [DEBUG   ] spawn_process: at 2018-10-26 01:28:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:28:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:28:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:28:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:28:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:28:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:28:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:28:06 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-26 01:28:17 [DEBUG   ] Got command BAM from MCS: ref #272725
2018-10-26 01:28:17 [INFO    ] Finished processing BAM request
2018-10-26 01:28:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272725   8 58417  5297025 A  ERROR'
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:28:17 [DEBUG   ] spawn_process: at 2018-10-26 01:28:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:28:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:28:22 [DEBUG   ] Got command RPT from MCS: ref #272726
2018-10-26 01:28:22 [DEBUG   ] summary = ERROR
2018-10-26 01:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272726  13 58417  5302801 A  ERRORERROR'
2018-10-26 01:28:23 [DEBUG   ] Got command RPT from MCS: ref #272727
2018-10-26 01:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272727  77 58417  5303005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:28:23 [DEBUG   ] Got command RPT from MCS: ref #272728
2018-10-26 01:28:23 [DEBUG   ] summary = ERROR
2018-10-26 01:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272728  13 58417  5303209 A  ERRORERROR'
2018-10-26 01:28:23 [DEBUG   ] Got command RPT from MCS: ref #272729
2018-10-26 01:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272729  77 58417  5303413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:28:23 [DEBUG   ] Got command RPT from MCS: ref #272730
2018-10-26 01:28:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272730  12 58417  5303605 A  ERRORBŸff'
2018-10-26 01:28:25 [DEBUG   ] Got command BAM from MCS: ref #272731
2018-10-26 01:28:25 [INFO    ] Finished processing BAM request
2018-10-26 01:28:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272731   8 58417  5305025 A  ERROR'
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:28:25 [DEBUG   ] spawn_process: at 2018-10-26 01:28:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:28:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:28:45 [DEBUG   ] Got command BAM from MCS: ref #272736
2018-10-26 01:28:45 [INFO    ] Finished processing BAM request
2018-10-26 01:28:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272736   8 58417  5325033 A  ERROR'
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:28:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:28:45 [DEBUG   ] spawn_process: at 2018-10-26 01:28:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:28:48 [DEBUG   ] Got command BAM from MCS: ref #272737
2018-10-26 01:28:48 [INFO    ] Finished processing BAM request
2018-10-26 01:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272737   8 58417  5328025 A  ERROR'
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:28:48 [DEBUG   ] spawn_process: at 2018-10-26 01:28:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:28:53 [DEBUG   ] Got command BAM from MCS: ref #272738
2018-10-26 01:28:53 [INFO    ] Finished processing BAM request
2018-10-26 01:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272738   8 58417  5333025 A  ERROR'
2018-10-26 01:28:53 [DEBUG   ] Got command BAM from MCS: ref #272739
2018-10-26 01:28:53 [INFO    ] Finished processing BAM request
2018-10-26 01:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272739   8 58417  5333029 A  ERROR'
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:28:53 [DEBUG   ] spawn_process: at 2018-10-26 01:28:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:28:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:29:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 01:29:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:29:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:29:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:29:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:29:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:29:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:29:06 [DEBUG   ] Finished updating board flags in 1.335 seconds
2018-10-26 01:29:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:29:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:29:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:30:02 [DEBUG   ] Got command BAM from MCS: ref #272742
2018-10-26 01:30:02 [INFO    ] Finished processing BAM request
2018-10-26 01:30:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272742   8 58417  5402029 A  ERROR'
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:30:02 [DEBUG   ] spawn_process: at 2018-10-26 01:30:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:30:05 [DEBUG   ] Got command BAM from MCS: ref #272743
2018-10-26 01:30:05 [INFO    ] Finished processing BAM request
2018-10-26 01:30:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272743   8 58417  5405033 A  ERROR'
2018-10-26 01:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-10-26 01:30:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:30:05 [DEBUG   ] spawn_process: at 2018-10-26 01:30:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:30:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:30:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:30:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:30:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:30:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:30:06 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-10-26 01:30:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 01:30:37 [DEBUG   ] Got command RPT from MCS: ref #272744
2018-10-26 01:30:37 [DEBUG   ] summary = ERROR
2018-10-26 01:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272744  13 58417  5437237 A  ERRORERROR'
2018-10-26 01:30:37 [DEBUG   ] Got command RPT from MCS: ref #272745
2018-10-26 01:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272745  77 58417  5437238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:30:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:30:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:31:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:31:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:31:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:31:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:31:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:31:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:31:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:31:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:31:06 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-10-26 01:31:11 [DEBUG   ] Got command BAM from MCS: ref #272761
2018-10-26 01:31:11 [INFO    ] Finished processing BAM request
2018-10-26 01:31:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272761   8 58417  5471033 A  ERROR'
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:31:11 [DEBUG   ] spawn_process: at 2018-10-26 01:31:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:31:17 [DEBUG   ] Got command BAM from MCS: ref #272762
2018-10-26 01:31:17 [INFO    ] Finished processing BAM request
2018-10-26 01:31:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272762   8 58417  5477025 A  ERROR'
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:31:17 [DEBUG   ] spawn_process: at 2018-10-26 01:31:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:31:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:31:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:31:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:32:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:32:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:32:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:32:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:32:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:32:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:32:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:32:06 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-26 01:32:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:32:20 [DEBUG   ] Got command BAM from MCS: ref #272767
2018-10-26 01:32:20 [INFO    ] Finished processing BAM request
2018-10-26 01:32:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272767   8 58417  5540025 A  ERROR'
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:32:20 [DEBUG   ] spawn_process: at 2018-10-26 01:32:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:32:29 [DEBUG   ] Got command BAM from MCS: ref #272768
2018-10-26 01:32:29 [INFO    ] Finished processing BAM request
2018-10-26 01:32:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272768   8 58417  5549029 A  ERROR'
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:32:29 [DEBUG   ] spawn_process: at 2018-10-26 01:32:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:32:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:32:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:33:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 01:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:33:06 [DEBUG   ] Finished updating board flags in 1.236 seconds
2018-10-26 01:33:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:33:22 [DEBUG   ] Got command RPT from MCS: ref #272771
2018-10-26 01:33:22 [DEBUG   ] summary = ERROR
2018-10-26 01:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272771  13 58417  5602893 A  ERRORERROR'
2018-10-26 01:33:23 [DEBUG   ] Got command RPT from MCS: ref #272772
2018-10-26 01:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272772  77 58417  5603097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:33:23 [DEBUG   ] Got command RPT from MCS: ref #272773
2018-10-26 01:33:23 [DEBUG   ] summary = ERROR
2018-10-26 01:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272773  13 58417  5603289 A  ERRORERROR'
2018-10-26 01:33:23 [DEBUG   ] Got command RPT from MCS: ref #272775
2018-10-26 01:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272775  77 58417  5603493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:33:23 [DEBUG   ] Got command RPT from MCS: ref #272776
2018-10-26 01:33:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272776  12 58417  5603697 A  ERRORBŸff'
2018-10-26 01:33:29 [DEBUG   ] Got command BAM from MCS: ref #272781
2018-10-26 01:33:29 [INFO    ] Finished processing BAM request
2018-10-26 01:33:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272781   8 58417  5609029 A  ERROR'
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:33:29 [DEBUG   ] spawn_process: at 2018-10-26 01:33:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:33:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:33:41 [DEBUG   ] Got command BAM from MCS: ref #272782
2018-10-26 01:33:41 [INFO    ] Finished processing BAM request
2018-10-26 01:33:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272782   8 58417  5621033 A  ERROR'
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:33:41 [DEBUG   ] spawn_process: at 2018-10-26 01:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:33:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:34:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:34:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:34:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:34:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:34:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:34:06 [DEBUG   ] Finished updating board flags in 1.128 seconds
2018-10-26 01:34:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:34:38 [DEBUG   ] Got command BAM from MCS: ref #272783
2018-10-26 01:34:38 [INFO    ] Finished processing BAM request
2018-10-26 01:34:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272783   8 58417  5678029 A  ERROR'
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:34:38 [DEBUG   ] spawn_process: at 2018-10-26 01:34:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:34:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:34:53 [DEBUG   ] Got command BAM from MCS: ref #272788
2018-10-26 01:34:53 [INFO    ] Finished processing BAM request
2018-10-26 01:34:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272788   8 58417  5693033 A  ERROR'
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:34:53 [DEBUG   ] spawn_process: at 2018-10-26 01:34:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:34:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:35:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:35:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 01:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:35:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:35:06 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 01:35:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:35:37 [DEBUG   ] Got command RPT from MCS: ref #272789
2018-10-26 01:35:37 [DEBUG   ] summary = ERROR
2018-10-26 01:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272789  13 58417  5737237 A  ERRORERROR'
2018-10-26 01:35:37 [DEBUG   ] Got command RPT from MCS: ref #272790
2018-10-26 01:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272790  77 58417  5737238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:35:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:35:47 [DEBUG   ] Got command BAM from MCS: ref #272806
2018-10-26 01:35:47 [INFO    ] Finished processing BAM request
2018-10-26 01:35:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:35:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272806   8 58417  5747029 A  ERROR'
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:35:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:35:47 [DEBUG   ] spawn_process: at 2018-10-26 01:35:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:35:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:36:05 [DEBUG   ] Got command BAM from MCS: ref #272807
2018-10-26 01:36:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272807   8 58417  5765029 A  ERROR'
2018-10-26 01:36:05 [INFO    ] Finished processing BAM request
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:36:05 [DEBUG   ] spawn_process: at 2018-10-26 01:36:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:36:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 01:36:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:36:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:36:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:36:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:36:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:36:06 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-10-26 01:36:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:36:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:36:56 [DEBUG   ] Got command BAM from MCS: ref #272808
2018-10-26 01:36:56 [INFO    ] Finished processing BAM request
2018-10-26 01:36:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272808   8 58417  5816033 A  ERROR'
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:36:56 [DEBUG   ] spawn_process: at 2018-10-26 01:36:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:36:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:37:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:37:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:37:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:37:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:37:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:37:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:37:07 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-26 01:37:18 [DEBUG   ] Got command BAM from MCS: ref #272809
2018-10-26 01:37:18 [INFO    ] Finished processing BAM request
2018-10-26 01:37:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272809   8 58417  5838025 A  ERROR'
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:37:18 [DEBUG   ] spawn_process: at 2018-10-26 01:37:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:37:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:37:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:37:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:38:05 [DEBUG   ] Got command BAM from MCS: ref #272814
2018-10-26 01:38:05 [INFO    ] Finished processing BAM request
2018-10-26 01:38:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272814   8 58417  5885029 A  ERROR'
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:38:05 [DEBUG   ] spawn_process: at 2018-10-26 01:38:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:38:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:38:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:38:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:38:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:38:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:38:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:38:06 [DEBUG   ] Finished updating board flags in 1.233 seconds
2018-10-26 01:38:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:38:22 [DEBUG   ] Got command RPT from MCS: ref #272815
2018-10-26 01:38:22 [DEBUG   ] summary = ERROR
2018-10-26 01:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272815  13 58417  5902973 A  ERRORERROR'
2018-10-26 01:38:23 [DEBUG   ] Got command RPT from MCS: ref #272816
2018-10-26 01:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272816  77 58417  5903177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:38:23 [DEBUG   ] Got command RPT from MCS: ref #272817
2018-10-26 01:38:23 [DEBUG   ] summary = ERROR
2018-10-26 01:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272817  13 58417  5903381 A  ERRORERROR'
2018-10-26 01:38:23 [DEBUG   ] Got command RPT from MCS: ref #272818
2018-10-26 01:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272818  77 58417  5903573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:38:23 [DEBUG   ] Got command RPT from MCS: ref #272819
2018-10-26 01:38:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272819  12 58417  5903777 A  ERRORBžff'
2018-10-26 01:38:31 [DEBUG   ] Got command BAM from MCS: ref #272820
2018-10-26 01:38:31 [INFO    ] Finished processing BAM request
2018-10-26 01:38:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272820   8 58417  5911029 A  ERROR'
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:38:31 [DEBUG   ] spawn_process: at 2018-10-26 01:38:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:38:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:38:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 01:39:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:39:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:39:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:39:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:39:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:39:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:39:07 [DEBUG   ] Finished updating board flags in 1.844 seconds
2018-10-26 01:39:14 [DEBUG   ] Got command BAM from MCS: ref #272821
2018-10-26 01:39:14 [INFO    ] Finished processing BAM request
2018-10-26 01:39:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272821   8 58417  5954033 A  ERROR'
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:39:14 [DEBUG   ] spawn_process: at 2018-10-26 01:39:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:39:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:39:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:39:44 [DEBUG   ] Got command BAM from MCS: ref #272822
2018-10-26 01:39:44 [INFO    ] Finished processing BAM request
2018-10-26 01:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272822   8 58417  5984029 A  ERROR'
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:39:44 [DEBUG   ] spawn_process: at 2018-10-26 01:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:39:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:40:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:40:06 [DEBUG   ] Finished updating board flags in 1.082 seconds
2018-10-26 01:40:19 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-10-26 01:40:23 [DEBUG   ] Got command BAM from MCS: ref #272823
2018-10-26 01:40:23 [INFO    ] Finished processing BAM request
2018-10-26 01:40:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272823   8 58417  6023033 A  ERROR'
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:40:23 [DEBUG   ] spawn_process: at 2018-10-26 01:40:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:40:37 [DEBUG   ] Got command RPT from MCS: ref #272824
2018-10-26 01:40:37 [DEBUG   ] summary = ERROR
2018-10-26 01:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272824  13 58417  6037229 A  ERRORERROR'
2018-10-26 01:40:37 [DEBUG   ] Got command RPT from MCS: ref #272825
2018-10-26 01:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272825  77 58417  6037230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:40:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 01:40:57 [DEBUG   ] Got command BAM from MCS: ref #272845
2018-10-26 01:40:57 [INFO    ] Finished processing BAM request
2018-10-26 01:40:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272845   8 58417  6057033 A  ERROR'
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:40:57 [DEBUG   ] spawn_process: at 2018-10-26 01:40:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:40:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 01:41:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 01:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:41:06 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 01:41:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:41:33 [DEBUG   ] Got command BAM from MCS: ref #272846
2018-10-26 01:41:33 [INFO    ] Finished processing BAM request
2018-10-26 01:41:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272846   8 58417  6093025 A  ERROR'
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:41:33 [DEBUG   ] spawn_process: at 2018-10-26 01:41:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:41:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:41:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 01:42:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:42:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 01:42:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:42:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:42:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:42:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:42:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:42:07 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-26 01:42:10 [DEBUG   ] Got command BAM from MCS: ref #272847
2018-10-26 01:42:10 [INFO    ] Finished processing BAM request
2018-10-26 01:42:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272847   8 58417  6130025 A  ERROR'
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:42:10 [DEBUG   ] spawn_process: at 2018-10-26 01:42:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:42:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:42:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:42:43 [DEBUG   ] Got command BAM from MCS: ref #272848
2018-10-26 01:42:43 [INFO    ] Finished processing BAM request
2018-10-26 01:42:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272848   8 58417  6163025 A  ERROR'
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:42:43 [DEBUG   ] spawn_process: at 2018-10-26 01:42:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:42:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 01:43:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:43:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:43:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:43:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:43:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:43:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:43:07 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-26 01:43:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 01:43:23 [DEBUG   ] Got command BAM from MCS: ref #272851
2018-10-26 01:43:23 [INFO    ] Finished processing BAM request
2018-10-26 01:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272851   8 58417  6203029 A  ERROR'
2018-10-26 01:43:23 [DEBUG   ] Got command RPT from MCS: ref #272852
2018-10-26 01:43:23 [DEBUG   ] summary = ERROR
2018-10-26 01:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272852  13 58417  6203065 A  ERRORERROR'
2018-10-26 01:43:23 [DEBUG   ] Got command RPT from MCS: ref #272853
2018-10-26 01:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272853  77 58417  6203257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:43:23 [DEBUG   ] Got command RPT from MCS: ref #272854
2018-10-26 01:43:23 [DEBUG   ] summary = ERROR
2018-10-26 01:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272854  13 58417  6203461 A  ERRORERROR'
2018-10-26 01:43:23 [DEBUG   ] Got command RPT from MCS: ref #272856
2018-10-26 01:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272856  77 58417  6203665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:43:23 [DEBUG   ] Got command RPT from MCS: ref #272857
2018-10-26 01:43:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272857  12 58417  6203869 A  ERRORBŸff'
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:43:23 [DEBUG   ] spawn_process: at 2018-10-26 01:43:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:43:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:43:53 [DEBUG   ] Got command BAM from MCS: ref #272866
2018-10-26 01:43:53 [INFO    ] Finished processing BAM request
2018-10-26 01:43:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272866   8 58417  6233025 A  ERROR'
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:43:53 [DEBUG   ] spawn_process: at 2018-10-26 01:43:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:44:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:44:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:44:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:44:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 01:44:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:44:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:44:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:44:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:44:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:44:07 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-10-26 01:44:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:44:36 [DEBUG   ] Got command BAM from MCS: ref #272867
2018-10-26 01:44:36 [INFO    ] Finished processing BAM request
2018-10-26 01:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272867   8 58417  6276029 A  ERROR'
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:44:36 [DEBUG   ] spawn_process: at 2018-10-26 01:44:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:44:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:45:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:45:03 [DEBUG   ] Got command BAM from MCS: ref #272868
2018-10-26 01:45:03 [INFO    ] Finished processing BAM request
2018-10-26 01:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272868   8 58417  6303033 A  ERROR'
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:45:03 [DEBUG   ] spawn_process: at 2018-10-26 01:45:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:45:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:45:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:45:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:45:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:45:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:45:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:45:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:45:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:45:07 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-10-26 01:45:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:45:37 [DEBUG   ] Got command RPT from MCS: ref #272869
2018-10-26 01:45:37 [DEBUG   ] summary = ERROR
2018-10-26 01:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272869  13 58417  6337241 A  ERRORERROR'
2018-10-26 01:45:37 [DEBUG   ] Got command RPT from MCS: ref #272870
2018-10-26 01:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272870  77 58417  6337242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:45:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:45:49 [DEBUG   ] Got command BAM from MCS: ref #272886
2018-10-26 01:45:49 [INFO    ] Finished processing BAM request
2018-10-26 01:45:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272886   8 58417  6349029 A  ERROR'
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:45:49 [DEBUG   ] spawn_process: at 2018-10-26 01:45:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:46:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:46:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:46:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:46:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:46:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:46:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:46:07 [DEBUG   ] Finished updating board flags in 1.079 seconds
2018-10-26 01:46:13 [DEBUG   ] Got command BAM from MCS: ref #272887
2018-10-26 01:46:13 [INFO    ] Finished processing BAM request
2018-10-26 01:46:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272887   8 58417  6373033 A  ERROR'
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:46:13 [DEBUG   ] spawn_process: at 2018-10-26 01:46:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:46:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:46:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:47:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:47:02 [DEBUG   ] Got command BAM from MCS: ref #272892
2018-10-26 01:47:02 [INFO    ] Finished processing BAM request
2018-10-26 01:47:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272892   8 58417  6422029 A  ERROR'
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:47:02 [DEBUG   ] spawn_process: at 2018-10-26 01:47:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:47:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 01:47:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:47:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:47:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:47:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:47:08 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-10-26 01:47:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:47:23 [DEBUG   ] Got command BAM from MCS: ref #272893
2018-10-26 01:47:23 [INFO    ] Finished processing BAM request
2018-10-26 01:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272893   8 58417  6443029 A  ERROR'
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:47:23 [DEBUG   ] spawn_process: at 2018-10-26 01:47:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:47:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 01:48:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:48:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:48:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:48:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:48:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:48:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:48:07 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-26 01:48:15 [DEBUG   ] Got command BAM from MCS: ref #272894
2018-10-26 01:48:15 [INFO    ] Finished processing BAM request
2018-10-26 01:48:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272894   8 58417  6495029 A  ERROR'
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:48:15 [DEBUG   ] spawn_process: at 2018-10-26 01:48:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:48:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:48:23 [DEBUG   ] Got command RPT from MCS: ref #272895
2018-10-26 01:48:23 [DEBUG   ] summary = ERROR
2018-10-26 01:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272895  13 58417  6503141 A  ERRORERROR'
2018-10-26 01:48:23 [DEBUG   ] Got command RPT from MCS: ref #272896
2018-10-26 01:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272896  77 58417  6503345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:48:23 [DEBUG   ] Got command RPT from MCS: ref #272897
2018-10-26 01:48:23 [DEBUG   ] summary = ERROR
2018-10-26 01:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272897  13 58417  6503549 A  ERRORERROR'
2018-10-26 01:48:23 [DEBUG   ] Got command RPT from MCS: ref #272898
2018-10-26 01:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272898  77 58417  6503753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:48:23 [DEBUG   ] Got command RPT from MCS: ref #272899
2018-10-26 01:48:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272899  12 58417  6503945 A  ERRORBŸff'
2018-10-26 01:48:33 [DEBUG   ] Got command BAM from MCS: ref #272900
2018-10-26 01:48:33 [INFO    ] Finished processing BAM request
2018-10-26 01:48:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272900   8 58417  6513033 A  ERROR'
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:48:33 [DEBUG   ] spawn_process: at 2018-10-26 01:48:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:48:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:48:53 [DEBUG   ] Got command BAM from MCS: ref #272901
2018-10-26 01:48:53 [INFO    ] Finished processing BAM request
2018-10-26 01:48:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272901   8 58417  6533025 A  ERROR'
2018-10-26 01:48:53 [DEBUG   ] Got command BAM from MCS: ref #272902
2018-10-26 01:48:53 [INFO    ] Finished processing BAM request
2018-10-26 01:48:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272902   8 58417  6533029 A  ERROR'
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:48:53 [DEBUG   ] spawn_process: at 2018-10-26 01:48:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:49:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:49:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:49:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:49:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:49:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:49:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:49:07 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-26 01:49:17 [DEBUG   ] Got command BAM from MCS: ref #272905
2018-10-26 01:49:17 [INFO    ] Finished processing BAM request
2018-10-26 01:49:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272905   8 58417  6557029 A  ERROR'
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:49:17 [DEBUG   ] spawn_process: at 2018-10-26 01:49:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:49:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:49:22 [DEBUG   ] Got command BAM from MCS: ref #272906
2018-10-26 01:49:22 [INFO    ] Finished processing BAM request
2018-10-26 01:49:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272906   8 58417  6562029 A  ERROR'
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:49:22 [DEBUG   ] spawn_process: at 2018-10-26 01:49:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:49:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:49:41 [DEBUG   ] Got command BAM from MCS: ref #272910
2018-10-26 01:49:41 [INFO    ] Finished processing BAM request
2018-10-26 01:49:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272910   8 58417  6581029 A  ERROR'
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:49:41 [DEBUG   ] spawn_process: at 2018-10-26 01:49:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:49:51 [DEBUG   ] Got command BAM from MCS: ref #272912
2018-10-26 01:49:51 [INFO    ] Finished processing BAM request
2018-10-26 01:49:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272912   8 58417  6591029 A  ERROR'
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:49:51 [DEBUG   ] spawn_process: at 2018-10-26 01:49:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:50:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:50:05 [DEBUG   ] Got command BAM from MCS: ref #272913
2018-10-26 01:50:05 [INFO    ] Finished processing BAM request
2018-10-26 01:50:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272913   8 58417  6605029 A  ERROR'
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:50:05 [DEBUG   ] spawn_process: at 2018-10-26 01:50:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 01:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:50:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 01:50:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:50:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:50:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:50:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:50:07 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-10-26 01:50:20 [DEBUG   ] Got command BAM from MCS: ref #272914
2018-10-26 01:50:20 [INFO    ] Finished processing BAM request
2018-10-26 01:50:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272914   8 58417  6620033 A  ERROR'
2018-10-26 01:50:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:50:20 [DEBUG   ] spawn_process: at 2018-10-26 01:50:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:50:29 [DEBUG   ] Got command BAM from MCS: ref #272915
2018-10-26 01:50:29 [INFO    ] Finished processing BAM request
2018-10-26 01:50:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272915   8 58417  6629033 A  ERROR'
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:50:29 [DEBUG   ] spawn_process: at 2018-10-26 01:50:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:50:37 [DEBUG   ] Got command RPT from MCS: ref #272916
2018-10-26 01:50:37 [DEBUG   ] summary = ERROR
2018-10-26 01:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272916  13 58417  6637233 A  ERRORERROR'
2018-10-26 01:50:37 [DEBUG   ] Got command RPT from MCS: ref #272917
2018-10-26 01:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272917  77 58417  6637234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:50:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:50:50 [DEBUG   ] Got command BAM from MCS: ref #272933
2018-10-26 01:50:50 [INFO    ] Finished processing BAM request
2018-10-26 01:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272933   8 58417  6650025 A  ERROR'
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:50:50 [DEBUG   ] spawn_process: at 2018-10-26 01:50:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:50:53 [DEBUG   ] Got command BAM from MCS: ref #272934
2018-10-26 01:50:53 [INFO    ] Finished processing BAM request
2018-10-26 01:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272934   8 58417  6653029 A  ERROR'
2018-10-26 01:50:53 [DEBUG   ] Got command BAM from MCS: ref #272935
2018-10-26 01:50:53 [INFO    ] Finished processing BAM request
2018-10-26 01:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272935   8 58417  6653033 A  ERROR'
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:50:53 [DEBUG   ] spawn_process: at 2018-10-26 01:50:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:51:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:51:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:51:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:51:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:51:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:51:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:51:07 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-10-26 01:51:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 01:51:40 [DEBUG   ] Finished updating ant stats in 1.087 seconds
2018-10-26 01:52:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:52:04 [DEBUG   ] Got command BAM from MCS: ref #272938
2018-10-26 01:52:04 [INFO    ] Finished processing BAM request
2018-10-26 01:52:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:52:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272938   8 58417  6724033 A  ERROR'
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:52:04 [DEBUG   ] spawn_process: at 2018-10-26 01:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:52:07 [DEBUG   ] Got command BAM from MCS: ref #272939
2018-10-26 01:52:07 [INFO    ] Finished processing BAM request
2018-10-26 01:52:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:52:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272939   8 58417  6727025 A  ERROR'
2018-10-26 01:52:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-26 01:52:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 01:52:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 01:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:52:07 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 01:52:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 01:52:07 [DEBUG   ] spawn_process: at 2018-10-26 01:52:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 01:52:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:52:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:53:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:53:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:53:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:53:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:53:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:53:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:53:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:53:08 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-10-26 01:53:15 [DEBUG   ] Got command BAM from MCS: ref #272946
2018-10-26 01:53:15 [INFO    ] Finished processing BAM request
2018-10-26 01:53:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272946   8 58417  6795025 A  ERROR'
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:53:15 [DEBUG   ] spawn_process: at 2018-10-26 01:53:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:53:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:53:21 [DEBUG   ] Got command BAM from MCS: ref #272947
2018-10-26 01:53:21 [INFO    ] Finished processing BAM request
2018-10-26 01:53:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272947   8 58417  6801025 A  ERROR'
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:53:21 [DEBUG   ] spawn_process: at 2018-10-26 01:53:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:53:23 [DEBUG   ] Got command RPT from MCS: ref #272948
2018-10-26 01:53:23 [DEBUG   ] summary = ERROR
2018-10-26 01:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272948  13 58417  6803233 A  ERRORERROR'
2018-10-26 01:53:23 [DEBUG   ] Got command RPT from MCS: ref #272949
2018-10-26 01:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272949  77 58417  6803425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:53:23 [DEBUG   ] Got command RPT from MCS: ref #272950
2018-10-26 01:53:23 [DEBUG   ] summary = ERROR
2018-10-26 01:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272950  13 58417  6803629 A  ERRORERROR'
2018-10-26 01:53:23 [DEBUG   ] Got command RPT from MCS: ref #272952
2018-10-26 01:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272952  77 58417  6803833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:53:24 [DEBUG   ] Got command RPT from MCS: ref #272953
2018-10-26 01:53:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272953  12 58417  6804037 A  ERRORBŸff'
2018-10-26 01:53:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:54:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:54:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-26 01:54:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:54:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:54:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:54:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:54:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:54:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:54:08 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-26 01:54:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 01:54:26 [DEBUG   ] Got command BAM from MCS: ref #272958
2018-10-26 01:54:26 [INFO    ] Finished processing BAM request
2018-10-26 01:54:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272958   8 58417  6866029 A  ERROR'
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:54:26 [DEBUG   ] spawn_process: at 2018-10-26 01:54:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:54:35 [DEBUG   ] Got command BAM from MCS: ref #272959
2018-10-26 01:54:35 [INFO    ] Finished processing BAM request
2018-10-26 01:54:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272959   8 58417  6875029 A  ERROR'
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:54:35 [DEBUG   ] spawn_process: at 2018-10-26 01:54:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:54:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 01:55:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:55:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:55:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:55:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:55:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:55:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:55:08 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-10-26 01:55:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:55:37 [DEBUG   ] Got command BAM from MCS: ref #272960
2018-10-26 01:55:37 [INFO    ] Finished processing BAM request
2018-10-26 01:55:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272960   8 58417  6937033 A  ERROR'
2018-10-26 01:55:37 [DEBUG   ] Got command RPT from MCS: ref #272961
2018-10-26 01:55:37 [DEBUG   ] summary = ERROR
2018-10-26 01:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272961  13 58417  6937237 A  ERRORERROR'
2018-10-26 01:55:37 [DEBUG   ] Got command RPT from MCS: ref #272962
2018-10-26 01:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272962  77 58417  6937238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:55:37 [DEBUG   ] spawn_process: at 2018-10-26 01:55:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:55:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:55:49 [DEBUG   ] Got command BAM from MCS: ref #272982
2018-10-26 01:55:49 [INFO    ] Finished processing BAM request
2018-10-26 01:55:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272982   8 58417  6949033 A  ERROR'
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:55:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:55:49 [DEBUG   ] spawn_process: at 2018-10-26 01:55:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:56:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:56:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:56:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 01:56:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:56:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:56:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:56:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:56:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:56:08 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-10-26 01:56:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:56:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:56:48 [DEBUG   ] Got command BAM from MCS: ref #272983
2018-10-26 01:56:48 [INFO    ] Finished processing BAM request
2018-10-26 01:56:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272983   8 58417  7008029 A  ERROR'
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:56:48 [DEBUG   ] spawn_process: at 2018-10-26 01:56:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:57:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:57:03 [DEBUG   ] Got command BAM from MCS: ref #272984
2018-10-26 01:57:03 [INFO    ] Finished processing BAM request
2018-10-26 01:57:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:57:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272984   8 58417  7023033 A  ERROR'
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 01:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 01:57:03 [DEBUG   ] spawn_process: at 2018-10-26 01:57:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 01:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:57:09 [WARNING ] (13, 1, 'bot')
2018-10-26 01:57:09 [WARNING ] (13, 1, 'bot')
2018-10-26 01:57:09 [WARNING ] (13, 1, 'bot')
2018-10-26 01:57:09 [WARNING ] (13, 1, 'bot')
2018-10-26 01:57:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:57:09 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-26 01:57:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:57:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:57:59 [DEBUG   ] Got command BAM from MCS: ref #272985
2018-10-26 01:57:59 [INFO    ] Finished processing BAM request
2018-10-26 01:57:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:57:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272985   8 58417  7079025 A  ERROR'
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:57:59 [DEBUG   ] spawn_process: at 2018-10-26 01:57:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:58:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 01:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 01:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:58:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:58:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:58:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:58:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:58:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:58:08 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-10-26 01:58:17 [DEBUG   ] Got command BAM from MCS: ref #272986
2018-10-26 01:58:17 [INFO    ] Finished processing BAM request
2018-10-26 01:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272986   8 58417  7097030 A  ERROR'
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 01:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 01:58:17 [DEBUG   ] spawn_process: at 2018-10-26 01:58:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 01:58:20 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2018-10-26 01:58:23 [DEBUG   ] Got command RPT from MCS: ref #272987
2018-10-26 01:58:23 [DEBUG   ] summary = ERROR
2018-10-26 01:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272987  13 58417  7103321 A  ERRORERROR'
2018-10-26 01:58:23 [DEBUG   ] Got command RPT from MCS: ref #272988
2018-10-26 01:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272988  77 58417  7103513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:58:23 [DEBUG   ] Got command RPT from MCS: ref #272989
2018-10-26 01:58:23 [DEBUG   ] summary = ERROR
2018-10-26 01:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272989  13 58417  7103717 A  ERRORERROR'
2018-10-26 01:58:23 [DEBUG   ] Got command RPT from MCS: ref #272990
2018-10-26 01:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 01:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272990  77 58417  7103924 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 01:58:24 [DEBUG   ] Got command RPT from MCS: ref #272991
2018-10-26 01:58:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 01:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272991  12 58417  7104125 A  ERRORBŸff'
2018-10-26 01:58:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:59:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:59:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 01:59:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 01:59:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:59:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:59:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:59:08 [WARNING ] (13, 1, 'bot')
2018-10-26 01:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 01:59:08 [DEBUG   ] Finished updating board flags in 1.031 seconds
2018-10-26 01:59:10 [DEBUG   ] Got command BAM from MCS: ref #272996
2018-10-26 01:59:10 [INFO    ] Finished processing BAM request
2018-10-26 01:59:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272996   8 58417  7150033 A  ERROR'
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 01:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 01:59:10 [DEBUG   ] spawn_process: at 2018-10-26 01:59:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 01:59:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 01:59:31 [DEBUG   ] Got command BAM from MCS: ref #272997
2018-10-26 01:59:31 [INFO    ] Finished processing BAM request
2018-10-26 01:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 01:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272997   8 58417  7171033 A  ERROR'
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 01:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 01:59:31 [DEBUG   ] spawn_process: at 2018-10-26 01:59:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 01:59:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:00:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:00:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 02:00:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:00:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:00:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:00:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:00:08 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-10-26 02:00:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:00:22 [DEBUG   ] Got command BAM from MCS: ref #272998
2018-10-26 02:00:22 [INFO    ] Finished processing BAM request
2018-10-26 02:00:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   272998   8 58417  7222033 A  ERROR'
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 02:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 02:00:22 [DEBUG   ] spawn_process: at 2018-10-26 02:00:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 02:00:37 [DEBUG   ] Got command RPT from MCS: ref #272999
2018-10-26 02:00:37 [DEBUG   ] summary = ERROR
2018-10-26 02:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   272999  13 58417  7237237 A  ERRORERROR'
2018-10-26 02:00:37 [DEBUG   ] Got command RPT from MCS: ref #273000
2018-10-26 02:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273000  77 58417  7237238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:00:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:00:46 [DEBUG   ] Got command BAM from MCS: ref #273016
2018-10-26 02:00:46 [INFO    ] Finished processing BAM request
2018-10-26 02:00:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273016   8 58417  7246025 A  ERROR'
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 02:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 02:00:46 [DEBUG   ] spawn_process: at 2018-10-26 02:00:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 02:01:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:01:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:01:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:01:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 02:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2018-10-26 02:01:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 02:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 02:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:01:08 [DEBUG   ] Finished updating board flags in 0.960 seconds
2018-10-26 02:01:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:01:34 [DEBUG   ] Got command BAM from MCS: ref #273017
2018-10-26 02:01:34 [INFO    ] Finished processing BAM request
2018-10-26 02:01:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273017   8 58417  7294033 A  ERROR'
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 02:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 02:01:34 [DEBUG   ] spawn_process: at 2018-10-26 02:01:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 02:01:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:02:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:02:01 [DEBUG   ] Got command BAM from MCS: ref #273022
2018-10-26 02:02:01 [INFO    ] Finished processing BAM request
2018-10-26 02:02:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273022   8 58417  7321030 A  ERROR'
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:02:01 [DEBUG   ] spawn_process: at 2018-10-26 02:02:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:02:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 02:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:02:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 02:02:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:02:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:02:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:02:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:02:09 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-26 02:02:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:02:41 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-26 02:02:46 [DEBUG   ] Got command BAM from MCS: ref #273023
2018-10-26 02:02:46 [INFO    ] Finished processing BAM request
2018-10-26 02:02:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:02:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273023   8 58417  7366034 A  ERROR'
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 02:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 02:02:46 [DEBUG   ] spawn_process: at 2018-10-26 02:02:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 02:03:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 02:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:03:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 02:03:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:03:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:03:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:03:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:03:09 [DEBUG   ] Finished updating board flags in 1.164 seconds
2018-10-26 02:03:16 [DEBUG   ] Got command BAM from MCS: ref #273026
2018-10-26 02:03:16 [INFO    ] Finished processing BAM request
2018-10-26 02:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273026   8 58417  7396026 A  ERROR'
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 02:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 02:03:16 [DEBUG   ] spawn_process: at 2018-10-26 02:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 02:03:21 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-26 02:03:23 [DEBUG   ] Got command RPT from MCS: ref #273027
2018-10-26 02:03:23 [DEBUG   ] summary = ERROR
2018-10-26 02:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273027  13 58417  7403397 A  ERRORERROR'
2018-10-26 02:03:23 [DEBUG   ] Got command RPT from MCS: ref #273028
2018-10-26 02:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273028  77 58417  7403601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:03:23 [DEBUG   ] Got command RPT from MCS: ref #273029
2018-10-26 02:03:23 [DEBUG   ] summary = ERROR
2018-10-26 02:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273029  13 58417  7403805 A  ERRORERROR'
2018-10-26 02:03:23 [DEBUG   ] Got command RPT from MCS: ref #273031
2018-10-26 02:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273031  77 58417  7403997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:03:24 [DEBUG   ] Got command RPT from MCS: ref #273032
2018-10-26 02:03:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273032  12 58417  7404201 A  ERRORB ff'
2018-10-26 02:03:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:03:56 [DEBUG   ] Got command BAM from MCS: ref #273037
2018-10-26 02:03:56 [INFO    ] Finished processing BAM request
2018-10-26 02:03:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273037   8 58417  7436029 A  ERROR'
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 02:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 02:03:56 [DEBUG   ] spawn_process: at 2018-10-26 02:03:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 02:04:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:04:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 02:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 02:04:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:04:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:04:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:04:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:04:09 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-10-26 02:04:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:04:31 [DEBUG   ] Got command BAM from MCS: ref #273038
2018-10-26 02:04:31 [INFO    ] Finished processing BAM request
2018-10-26 02:04:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273038   8 58417  7471033 A  ERROR'
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 02:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 02:04:31 [DEBUG   ] spawn_process: at 2018-10-26 02:04:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 02:04:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:05:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:05:04 [DEBUG   ] Got command BAM from MCS: ref #273043
2018-10-26 02:05:04 [INFO    ] Finished processing BAM request
2018-10-26 02:05:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273043   8 58417  7504029 A  ERROR'
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 02:05:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 02:05:04 [DEBUG   ] spawn_process: at 2018-10-26 02:05:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 02:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:05:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 02:05:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:05:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:05:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:05:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:05:09 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-10-26 02:05:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:05:37 [DEBUG   ] Got command RPT from MCS: ref #273044
2018-10-26 02:05:37 [DEBUG   ] summary = ERROR
2018-10-26 02:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273044  13 58417  7537245 A  ERRORERROR'
2018-10-26 02:05:37 [DEBUG   ] Got command RPT from MCS: ref #273045
2018-10-26 02:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273045  77 58417  7537246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:05:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:05:46 [DEBUG   ] Got command BAM from MCS: ref #273061
2018-10-26 02:05:46 [INFO    ] Finished processing BAM request
2018-10-26 02:05:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:05:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273061   8 58417  7546025 A  ERROR'
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 02:05:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 02:05:46 [DEBUG   ] spawn_process: at 2018-10-26 02:05:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 02:06:01 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-26 02:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:06:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 02:06:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:06:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:06:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:06:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:06:09 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-10-26 02:06:10 [DEBUG   ] Got command BAM from MCS: ref #273062
2018-10-26 02:06:10 [INFO    ] Finished processing BAM request
2018-10-26 02:06:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273062   8 58417  7570033 A  ERROR'
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 02:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 02:06:10 [DEBUG   ] spawn_process: at 2018-10-26 02:06:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 02:06:20 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 02:06:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:07:01 [DEBUG   ] Got command BAM from MCS: ref #273063
2018-10-26 02:07:01 [INFO    ] Finished processing BAM request
2018-10-26 02:07:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273063   8 58417  7621033 A  ERROR'
2018-10-26 02:07:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 02:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 02:07:01 [DEBUG   ] spawn_process: at 2018-10-26 02:07:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 02:07:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:07:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 02:07:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 02:07:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 02:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 02:07:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:07:09 [DEBUG   ] Finished updating board flags in 1.173 seconds
2018-10-26 02:07:15 [DEBUG   ] Got command BAM from MCS: ref #273064
2018-10-26 02:07:15 [INFO    ] Finished processing BAM request
2018-10-26 02:07:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273064   8 58417  7635025 A  ERROR'
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 02:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 02:07:15 [DEBUG   ] spawn_process: at 2018-10-26 02:07:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 02:07:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 02:07:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:08:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 02:08:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:08:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 02:08:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:08:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:08:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:08:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:08:10 [DEBUG   ] Finished updating board flags in 1.642 seconds
2018-10-26 02:08:16 [DEBUG   ] Got command BAM from MCS: ref #273069
2018-10-26 02:08:16 [INFO    ] Finished processing BAM request
2018-10-26 02:08:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273069   8 58417  7696033 A  ERROR'
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:08:16 [DEBUG   ] spawn_process: at 2018-10-26 02:08:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:08:18 [DEBUG   ] Got command BAM from MCS: ref #273070
2018-10-26 02:08:18 [INFO    ] Finished processing BAM request
2018-10-26 02:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273070   8 58417  7698029 A  ERROR'
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 02:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 02:08:18 [DEBUG   ] spawn_process: at 2018-10-26 02:08:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 02:08:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:08:23 [DEBUG   ] Got command RPT from MCS: ref #273071
2018-10-26 02:08:23 [DEBUG   ] summary = ERROR
2018-10-26 02:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273071  13 58417  7703489 A  ERRORERROR'
2018-10-26 02:08:23 [DEBUG   ] Got command RPT from MCS: ref #273072
2018-10-26 02:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273072  77 58417  7703693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:08:23 [DEBUG   ] Got command RPT from MCS: ref #273073
2018-10-26 02:08:23 [DEBUG   ] summary = ERROR
2018-10-26 02:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273073  13 58417  7703885 A  ERRORERROR'
2018-10-26 02:08:24 [DEBUG   ] Got command RPT from MCS: ref #273074
2018-10-26 02:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273074  77 58417  7704089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:08:24 [DEBUG   ] Got command RPT from MCS: ref #273075
2018-10-26 02:08:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273075  12 58417  7704293 A  ERRORB¡ff'
2018-10-26 02:08:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:09:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 02:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 02:09:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:09:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 02:09:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:09:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:09:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:09:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:09:10 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-10-26 02:09:20 [DEBUG   ] Got command BAM from MCS: ref #273076
2018-10-26 02:09:20 [INFO    ] Finished processing BAM request
2018-10-26 02:09:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273076   8 58417  7760029 A  ERROR'
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 02:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 02:09:20 [DEBUG   ] spawn_process: at 2018-10-26 02:09:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 02:09:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 02:09:32 [DEBUG   ] Got command BAM from MCS: ref #273077
2018-10-26 02:09:32 [INFO    ] Finished processing BAM request
2018-10-26 02:09:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273077   8 58417  7772033 A  ERROR'
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 02:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 02:09:32 [DEBUG   ] spawn_process: at 2018-10-26 02:09:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 02:09:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:10:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 02:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 02:10:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 02:10:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 02:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 02:10:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:10:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:10:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:10:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:10:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:10:10 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-26 02:10:20 [DEBUG   ] Got command BAM from MCS: ref #273078
2018-10-26 02:10:20 [INFO    ] Finished processing BAM request
2018-10-26 02:10:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273078   8 58417  7820029 A  ERROR'
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 02:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 02:10:20 [DEBUG   ] spawn_process: at 2018-10-26 02:10:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 02:10:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:10:37 [DEBUG   ] Got command RPT from MCS: ref #273079
2018-10-26 02:10:37 [DEBUG   ] summary = ERROR
2018-10-26 02:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273079  13 58417  7837245 A  ERRORERROR'
2018-10-26 02:10:37 [DEBUG   ] Got command RPT from MCS: ref #273080
2018-10-26 02:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273080  77 58417  7837246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:10:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:10:48 [DEBUG   ] Got command BAM from MCS: ref #273100
2018-10-26 02:10:48 [INFO    ] Finished processing BAM request
2018-10-26 02:10:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273100   8 58417  7848029 A  ERROR'
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:10:48 [DEBUG   ] spawn_process: at 2018-10-26 02:10:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:10:53 [DEBUG   ] Got command BAM from MCS: ref #273102
2018-10-26 02:10:53 [INFO    ] Finished processing BAM request
2018-10-26 02:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273102   8 58417  7853029 A  ERROR'
2018-10-26 02:10:53 [DEBUG   ] Got command BAM from MCS: ref #273101
2018-10-26 02:10:53 [INFO    ] Finished processing BAM request
2018-10-26 02:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273101   8 58417  7853033 A  ERROR'
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:10:53 [DEBUG   ] spawn_process: at 2018-10-26 02:10:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:11:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 02:11:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 02:11:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:11:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 02:11:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:11:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:11:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:11:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:11:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:11:10 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-26 02:11:21 [DEBUG   ] Got command BAM from MCS: ref #273105
2018-10-26 02:11:21 [INFO    ] Finished processing BAM request
2018-10-26 02:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273105   8 58417  7881033 A  ERROR'
2018-10-26 02:11:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 02:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 02:11:21 [DEBUG   ] spawn_process: at 2018-10-26 02:11:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 02:11:26 [DEBUG   ] Got command BAM from MCS: ref #273106
2018-10-26 02:11:26 [INFO    ] Finished processing BAM request
2018-10-26 02:11:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273106   8 58417  7886029 A  ERROR'
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:11:26 [DEBUG   ] spawn_process: at 2018-10-26 02:11:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:11:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:11:49 [DEBUG   ] Got command BAM from MCS: ref #273107
2018-10-26 02:11:49 [INFO    ] Finished processing BAM request
2018-10-26 02:11:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273107   8 58417  7909033 A  ERROR'
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 02:11:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 02:11:49 [DEBUG   ] spawn_process: at 2018-10-26 02:11:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 02:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 02:11:50 [DEBUG   ] spawn_process: at 2018-10-26 02:11:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 02:12:00 [DEBUG   ] Got command BAM from MCS: ref #273108
2018-10-26 02:12:00 [INFO    ] Finished processing BAM request
2018-10-26 02:12:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273108   8 58417  7920033 A  ERROR'
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:12:00 [DEBUG   ] spawn_process: at 2018-10-26 02:12:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:12:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 02:12:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:12:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 02:12:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:12:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:12:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:12:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:12:10 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-26 02:12:17 [DEBUG   ] Got command BAM from MCS: ref #273109
2018-10-26 02:12:17 [INFO    ] Finished processing BAM request
2018-10-26 02:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273109   8 58417  7937025 A  ERROR'
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 02:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 02:12:17 [DEBUG   ] spawn_process: at 2018-10-26 02:12:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 02:12:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:12:34 [DEBUG   ] Got command BAM from MCS: ref #273110
2018-10-26 02:12:34 [INFO    ] Finished processing BAM request
2018-10-26 02:12:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273110   8 58417  7954029 A  ERROR'
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 02:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 02:12:34 [DEBUG   ] spawn_process: at 2018-10-26 02:12:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 02:12:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:12:45 [DEBUG   ] Got command BAM from MCS: ref #273111
2018-10-26 02:12:45 [INFO    ] Finished processing BAM request
2018-10-26 02:12:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 02:12:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   273111   8 58417  7965033 A  ERROR'
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 02:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 02:12:45 [DEBUG   ] spawn_process: at 2018-10-26 02:12:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 02:12:55 [DEBUG   ] Got command STP from MCS: ref #273113
2018-10-26 02:12:55 [INFO    ] Finished processing BAM request
2018-10-26 02:12:55 [INFO    ] Shutdown the adder chain on beam #3
2018-10-26 02:12:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   273113   8 58417  7975933 A  ERROR'
2018-10-26 02:12:55 [DEBUG   ] Got command STP from MCS: ref #273112
2018-10-26 02:12:55 [INFO    ] Finished processing BAM request
2018-10-26 02:12:55 [INFO    ] Shutdown the adder chain on beam #2
2018-10-26 02:12:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   273112   8 58417  7975937 A  ERROR'
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 02:12:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 02:12:56 [DEBUG   ] spawn_process: at 2018-10-26 02:12:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 02:13:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:13:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 02:13:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:13:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:13:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:13:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:13:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:13:10 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-10-26 02:13:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:13:23 [DEBUG   ] Got command RPT from MCS: ref #273116
2018-10-26 02:13:23 [DEBUG   ] summary = ERROR
2018-10-26 02:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273116  13 58417  8003565 A  ERRORERROR'
2018-10-26 02:13:23 [DEBUG   ] Got command RPT from MCS: ref #273117
2018-10-26 02:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273117  77 58417  8003769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:13:23 [DEBUG   ] Got command RPT from MCS: ref #273118
2018-10-26 02:13:23 [DEBUG   ] summary = ERROR
2018-10-26 02:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273118  13 58417  8003973 A  ERRORERROR'
2018-10-26 02:13:24 [DEBUG   ] Got command RPT from MCS: ref #273120
2018-10-26 02:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273120  77 58417  8004177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:13:24 [DEBUG   ] Got command RPT from MCS: ref #273121
2018-10-26 02:13:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273121  12 58417  8004369 A  ERRORBžff'
2018-10-26 02:13:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:14:02 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-10-26 02:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:14:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:14:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:14:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:14:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:14:10 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-26 02:14:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:14:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:15:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:15:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:15:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:15:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:15:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:15:10 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-10-26 02:15:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 02:15:37 [DEBUG   ] Got command RPT from MCS: ref #273130
2018-10-26 02:15:37 [DEBUG   ] summary = ERROR
2018-10-26 02:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273130  13 58417  8137245 A  ERRORERROR'
2018-10-26 02:15:37 [DEBUG   ] Got command RPT from MCS: ref #273131
2018-10-26 02:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273131  77 58417  8137246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:15:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:16:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:16:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:16:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:16:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:16:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:16:10 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-10-26 02:16:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:16:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:17:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:17:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:17:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:17:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:17:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:17:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:17:10 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-10-26 02:17:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:17:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:18:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 02:18:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:18:10 [DEBUG   ] Finished updating board flags in 1.289 seconds
2018-10-26 02:18:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:18:23 [DEBUG   ] Got command RPT from MCS: ref #273151
2018-10-26 02:18:23 [DEBUG   ] summary = ERROR
2018-10-26 02:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273151  13 58417  8303657 A  ERRORERROR'
2018-10-26 02:18:23 [DEBUG   ] Got command RPT from MCS: ref #273152
2018-10-26 02:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273152  77 58417  8303849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:18:24 [DEBUG   ] Got command RPT from MCS: ref #273153
2018-10-26 02:18:24 [DEBUG   ] summary = ERROR
2018-10-26 02:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273153  13 58417  8304053 A  ERRORERROR'
2018-10-26 02:18:24 [DEBUG   ] Got command RPT from MCS: ref #273154
2018-10-26 02:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273154  77 58417  8304257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:18:24 [DEBUG   ] Got command RPT from MCS: ref #273155
2018-10-26 02:18:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273155  12 58417  8304461 A  ERRORB–™š'
2018-10-26 02:18:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:19:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:19:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:19:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:19:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:19:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:19:11 [DEBUG   ] Finished updating board flags in 1.735 seconds
2018-10-26 02:19:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 02:19:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:20:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:20:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:20:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:20:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:20:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:20:11 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-26 02:20:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:20:37 [DEBUG   ] Got command RPT from MCS: ref #273160
2018-10-26 02:20:37 [DEBUG   ] summary = ERROR
2018-10-26 02:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273160  13 58417  8437249 A  ERRORERROR'
2018-10-26 02:20:37 [DEBUG   ] Got command RPT from MCS: ref #273161
2018-10-26 02:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273161  77 58417  8437250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:20:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:21:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:21:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:21:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:21:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:21:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:21:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:21:11 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-26 02:21:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:21:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:22:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:22:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:22:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:22:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:22:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:22:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:22:11 [DEBUG   ] Finished updating board flags in 1.337 seconds
2018-10-26 02:22:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:22:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:23:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:23:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:23:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:23:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:23:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:23:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:23:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:23:11 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-26 02:23:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:23:23 [DEBUG   ] Got command RPT from MCS: ref #273183
2018-10-26 02:23:23 [DEBUG   ] summary = ERROR
2018-10-26 02:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273183  13 58417  8603741 A  ERRORERROR'
2018-10-26 02:23:23 [DEBUG   ] Got command RPT from MCS: ref #273184
2018-10-26 02:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273184  77 58417  8603933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:23:24 [DEBUG   ] Got command RPT from MCS: ref #273185
2018-10-26 02:23:24 [DEBUG   ] summary = ERROR
2018-10-26 02:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273185  13 58417  8604137 A  ERRORERROR'
2018-10-26 02:23:24 [DEBUG   ] Got command RPT from MCS: ref #273187
2018-10-26 02:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273187  77 58417  8604341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:23:24 [DEBUG   ] Got command RPT from MCS: ref #273189
2018-10-26 02:23:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273189  12 58417  8604545 A  ERRORB”™š'
2018-10-26 02:23:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:24:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:24:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:24:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:24:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:24:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:24:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:24:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:24:11 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-10-26 02:24:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:24:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:25:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:25:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:25:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:25:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:25:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:25:11 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-26 02:25:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:25:37 [DEBUG   ] Got command RPT from MCS: ref #273193
2018-10-26 02:25:37 [DEBUG   ] summary = ERROR
2018-10-26 02:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273193  13 58417  8737241 A  ERRORERROR'
2018-10-26 02:25:37 [DEBUG   ] Got command RPT from MCS: ref #273194
2018-10-26 02:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273194  77 58417  8737242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:25:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:26:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:26:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:26:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:26:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:26:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:26:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:26:11 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-26 02:26:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:26:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:27:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:27:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:27:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:27:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:27:11 [WARNING ] (13, 1, 'bot')
2018-10-26 02:27:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:27:11 [DEBUG   ] Finished updating board flags in 1.063 seconds
2018-10-26 02:27:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:27:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:28:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:28:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:28:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:28:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:28:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:28:12 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 02:28:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 02:28:23 [DEBUG   ] Got command RPT from MCS: ref #273214
2018-10-26 02:28:23 [DEBUG   ] summary = ERROR
2018-10-26 02:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273214  13 58417  8903825 A  ERRORERROR'
2018-10-26 02:28:24 [DEBUG   ] Got command RPT from MCS: ref #273215
2018-10-26 02:28:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273215  77 58417  8904029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:28:24 [DEBUG   ] Got command RPT from MCS: ref #273216
2018-10-26 02:28:24 [DEBUG   ] summary = ERROR
2018-10-26 02:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273216  13 58417  8904221 A  ERRORERROR'
2018-10-26 02:28:24 [DEBUG   ] Got command RPT from MCS: ref #273217
2018-10-26 02:28:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273217  77 58417  8904425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:28:24 [DEBUG   ] Got command RPT from MCS: ref #273218
2018-10-26 02:28:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273218  12 58417  8904629 A  ERRORB•™š'
2018-10-26 02:28:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:29:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 02:29:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:29:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:29:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:29:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:29:12 [DEBUG   ] Finished updating board flags in 1.953 seconds
2018-10-26 02:29:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:29:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:30:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:30:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:30:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:30:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:30:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:30:12 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-26 02:30:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:30:37 [DEBUG   ] Got command RPT from MCS: ref #273223
2018-10-26 02:30:37 [DEBUG   ] summary = ERROR
2018-10-26 02:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273223  13 58417  9037246 A  ERRORERROR'
2018-10-26 02:30:37 [DEBUG   ] Got command RPT from MCS: ref #273224
2018-10-26 02:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273224  77 58417  9037246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:30:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:31:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:31:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 02:31:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:31:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:31:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:31:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:31:12 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-26 02:31:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:31:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:32:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:32:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:32:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:32:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:32:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:32:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:32:12 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 02:32:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:32:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:33:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:33:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:33:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:33:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:33:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:33:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:33:12 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-26 02:33:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:33:23 [DEBUG   ] Got command RPT from MCS: ref #273246
2018-10-26 02:33:23 [DEBUG   ] summary = ERROR
2018-10-26 02:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273246  13 58417  9203916 A  ERRORERROR'
2018-10-26 02:33:24 [DEBUG   ] Got command RPT from MCS: ref #273247
2018-10-26 02:33:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273247  77 58417  9204117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:33:24 [DEBUG   ] Got command RPT from MCS: ref #273248
2018-10-26 02:33:24 [DEBUG   ] summary = ERROR
2018-10-26 02:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273248  13 58417  9204309 A  ERRORERROR'
2018-10-26 02:33:24 [DEBUG   ] Got command RPT from MCS: ref #273250
2018-10-26 02:33:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273250  77 58417  9204513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:33:24 [DEBUG   ] Got command RPT from MCS: ref #273251
2018-10-26 02:33:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273251  12 58417  9204717 A  ERRORB—™š'
2018-10-26 02:33:43 [DEBUG   ] Finished updating ant stats in 0.667 seconds
2018-10-26 02:34:00 [DEBUG   ] Got command TBN from MCS: ref #273256
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-26 02:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   273256   8 58417  9240429 A  ERROR'
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540521241']
2018-10-26 02:34:00 [DEBUG   ] spawn_process: at 2018-10-26 02:34:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540521241']
2018-10-26 02:34:00 [INFO    ] Finished spawning TBN in 0.049 s
2018-10-26 02:34:03 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-26 02:34:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:34:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:34:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:34:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:34:12 [WARNING ] (13, 1, 'bot')
2018-10-26 02:34:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:34:12 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-10-26 02:34:23 [DEBUG   ] Finished updating ant stats in 0.669 seconds
2018-10-26 02:34:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 02:35:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:35:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:35:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:35:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:35:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:35:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:35:13 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-10-26 02:35:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 02:35:37 [DEBUG   ] Got command RPT from MCS: ref #273261
2018-10-26 02:35:37 [DEBUG   ] summary = ERROR
2018-10-26 02:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273261  13 58417  9337250 A  ERRORERROR'
2018-10-26 02:35:37 [DEBUG   ] Got command RPT from MCS: ref #273262
2018-10-26 02:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273262  77 58417  9337250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:35:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 02:36:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 02:36:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:36:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:36:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:36:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:36:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:36:13 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-10-26 02:36:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 02:36:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:37:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 02:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:37:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:37:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:37:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:37:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:37:13 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-10-26 02:37:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 02:37:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 02:38:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:38:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:38:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:38:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:38:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:38:13 [DEBUG   ] Finished updating board flags in 2.141 seconds
2018-10-26 02:38:23 [DEBUG   ] Got command RPT from MCS: ref #273282
2018-10-26 02:38:23 [DEBUG   ] summary = ERROR
2018-10-26 02:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273282  13 58417  9503997 A  ERRORERROR'
2018-10-26 02:38:24 [DEBUG   ] Got command RPT from MCS: ref #273283
2018-10-26 02:38:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273283  77 58417  9504201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:38:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 02:38:24 [DEBUG   ] Got command RPT from MCS: ref #273284
2018-10-26 02:38:24 [DEBUG   ] summary = ERROR
2018-10-26 02:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273284  13 58417  9504393 A  ERRORERROR'
2018-10-26 02:38:24 [DEBUG   ] Got command RPT from MCS: ref #273285
2018-10-26 02:38:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273285  77 58417  9504597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:38:24 [DEBUG   ] Got command RPT from MCS: ref #273286
2018-10-26 02:38:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273286  12 58417  9504801 A  ERRORB–™š'
2018-10-26 02:38:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 02:39:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 02:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:39:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:39:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:39:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:39:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:39:13 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-26 02:39:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 02:39:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 02:40:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 02:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:40:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:40:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:40:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:40:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:40:13 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 02:40:24 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-26 02:40:37 [DEBUG   ] Got command RPT from MCS: ref #273287
2018-10-26 02:40:37 [DEBUG   ] summary = ERROR
2018-10-26 02:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273287  13 58417  9637245 A  ERRORERROR'
2018-10-26 02:40:37 [DEBUG   ] Got command RPT from MCS: ref #273288
2018-10-26 02:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273288  77 58417  9637246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:40:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:41:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 02:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:41:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:41:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:41:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:41:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:41:13 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-26 02:41:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 02:41:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:42:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 02:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:42:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:42:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:42:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:42:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:42:13 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-26 02:42:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 02:42:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:43:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 02:43:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:43:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:43:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:43:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:43:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:43:13 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-26 02:43:24 [DEBUG   ] Got command RPT from MCS: ref #273310
2018-10-26 02:43:24 [DEBUG   ] summary = ERROR
2018-10-26 02:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273310  13 58417  9804081 A  ERRORERROR'
2018-10-26 02:43:24 [DEBUG   ] Got command RPT from MCS: ref #273311
2018-10-26 02:43:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273311  77 58417  9804285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:43:24 [DEBUG   ] Got command RPT from MCS: ref #273312
2018-10-26 02:43:24 [DEBUG   ] summary = ERROR
2018-10-26 02:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273312  13 58417  9804477 A  ERRORERROR'
2018-10-26 02:43:24 [DEBUG   ] Got command RPT from MCS: ref #273314
2018-10-26 02:43:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273314  77 58417  9804681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:43:24 [DEBUG   ] Got command RPT from MCS: ref #273315
2018-10-26 02:43:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273315  12 58417  9804885 A  ERRORB•™š'
2018-10-26 02:43:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 02:43:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:44:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:44:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:44:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:44:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:44:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:44:13 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-26 02:44:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 02:44:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 02:45:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 02:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:45:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:45:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:45:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:45:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:45:13 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-26 02:45:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 02:45:37 [DEBUG   ] Got command RPT from MCS: ref #273324
2018-10-26 02:45:37 [DEBUG   ] summary = ERROR
2018-10-26 02:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273324  13 58417  9937249 A  ERRORERROR'
2018-10-26 02:45:37 [DEBUG   ] Got command RPT from MCS: ref #273325
2018-10-26 02:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273325  77 58417  9937250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:45:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 02:46:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 02:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:46:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:46:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:46:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:46:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:46:13 [DEBUG   ] Finished updating board flags in 1.752 seconds
2018-10-26 02:46:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:46:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 02:47:06 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-26 02:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:47:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 02:47:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:47:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:47:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:47:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:47:13 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-26 02:47:25 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-26 02:47:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 02:48:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 02:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:48:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 02:48:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:48:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:48:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:48:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:48:13 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-10-26 02:48:24 [DEBUG   ] Got command RPT from MCS: ref #273345
2018-10-26 02:48:24 [DEBUG   ] summary = ERROR
2018-10-26 02:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273345  13 58417 10104169 A  ERRORERROR'
2018-10-26 02:48:24 [DEBUG   ] Got command RPT from MCS: ref #273346
2018-10-26 02:48:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273346  77 58417 10104373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:48:24 [DEBUG   ] Got command RPT from MCS: ref #273347
2018-10-26 02:48:24 [DEBUG   ] summary = ERROR
2018-10-26 02:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273347  13 58417 10104565 A  ERRORERROR'
2018-10-26 02:48:24 [DEBUG   ] Got command RPT from MCS: ref #273348
2018-10-26 02:48:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273348  77 58417 10104769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:48:24 [DEBUG   ] Got command RPT from MCS: ref #273349
2018-10-26 02:48:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273349  12 58417 10104973 A  ERRORB•™š'
2018-10-26 02:48:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:48:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 02:49:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 02:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:49:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:49:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:49:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:49:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:49:13 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-26 02:49:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 02:49:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 02:50:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 02:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:50:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:50:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:50:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:50:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:50:13 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-10-26 02:50:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 02:50:37 [DEBUG   ] Got command RPT from MCS: ref #273354
2018-10-26 02:50:37 [DEBUG   ] summary = ERROR
2018-10-26 02:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273354  13 58417 10237253 A  ERRORERROR'
2018-10-26 02:50:37 [DEBUG   ] Got command RPT from MCS: ref #273355
2018-10-26 02:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273355  77 58417 10237254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:50:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 02:51:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:51:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:51:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:51:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:51:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:51:13 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 02:51:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:51:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 02:52:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 02:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:52:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:52:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:52:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:52:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:52:13 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-10-26 02:52:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 02:52:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 02:53:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 02:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 02:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:53:13 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-26 02:53:24 [DEBUG   ] Got command RPT from MCS: ref #273377
2018-10-26 02:53:24 [DEBUG   ] summary = ERROR
2018-10-26 02:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273377  13 58417 10404253 A  ERRORERROR'
2018-10-26 02:53:24 [DEBUG   ] Got command RPT from MCS: ref #273378
2018-10-26 02:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273378  77 58417 10404457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:53:24 [DEBUG   ] Got command RPT from MCS: ref #273379
2018-10-26 02:53:24 [DEBUG   ] summary = ERROR
2018-10-26 02:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273379  13 58417 10404649 A  ERRORERROR'
2018-10-26 02:53:24 [DEBUG   ] Got command RPT from MCS: ref #273381
2018-10-26 02:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273381  77 58417 10404853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:53:25 [DEBUG   ] Got command RPT from MCS: ref #273382
2018-10-26 02:53:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273382  12 58417 10405057 A  ERRORB—™š'
2018-10-26 02:53:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 02:53:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:54:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 02:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:54:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:54:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:54:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:54:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:54:14 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-26 02:54:27 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 02:54:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 02:55:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 02:55:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 02:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:55:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:55:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:55:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:55:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:55:14 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-26 02:55:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 02:55:37 [DEBUG   ] Got command RPT from MCS: ref #273387
2018-10-26 02:55:37 [DEBUG   ] summary = ERROR
2018-10-26 02:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273387  13 58417 10537249 A  ERRORERROR'
2018-10-26 02:55:37 [DEBUG   ] Got command RPT from MCS: ref #273388
2018-10-26 02:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273388  77 58417 10537250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:55:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 02:56:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 02:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:56:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:56:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:56:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:56:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:56:14 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-26 02:56:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 02:56:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 02:57:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 02:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:57:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:57:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:57:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:57:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:57:14 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-26 02:57:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 02:57:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 02:58:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 02:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:58:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:58:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:58:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:58:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:58:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:58:14 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-26 02:58:24 [DEBUG   ] Got command RPT from MCS: ref #273408
2018-10-26 02:58:24 [DEBUG   ] summary = ERROR
2018-10-26 02:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273408  13 58417 10704341 A  ERRORERROR'
2018-10-26 02:58:24 [DEBUG   ] Got command RPT from MCS: ref #273409
2018-10-26 02:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273409  77 58417 10704533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:58:24 [DEBUG   ] Got command RPT from MCS: ref #273410
2018-10-26 02:58:24 [DEBUG   ] summary = ERROR
2018-10-26 02:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273410  13 58417 10704737 A  ERRORERROR'
2018-10-26 02:58:24 [DEBUG   ] Got command RPT from MCS: ref #273411
2018-10-26 02:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 02:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273411  77 58417 10704941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 02:58:25 [DEBUG   ] Got command RPT from MCS: ref #273412
2018-10-26 02:58:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 02:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273412  12 58417 10705145 A  ERRORB—™š'
2018-10-26 02:58:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 02:58:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 02:59:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 02:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 02:59:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:59:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:59:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:59:14 [WARNING ] (13, 1, 'bot')
2018-10-26 02:59:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 02:59:14 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-26 02:59:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 02:59:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:00:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 03:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:00:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:00:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:00:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:00:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:00:14 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-26 03:00:28 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-26 03:00:37 [DEBUG   ] Got command RPT from MCS: ref #273417
2018-10-26 03:00:37 [DEBUG   ] summary = ERROR
2018-10-26 03:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273417  13 58417 10837253 A  ERRORERROR'
2018-10-26 03:00:37 [DEBUG   ] Got command RPT from MCS: ref #273418
2018-10-26 03:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273418  77 58417 10837254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:00:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 03:01:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 03:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:01:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 03:01:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:01:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:01:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:01:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:01:14 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-26 03:01:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:01:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:02:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:02:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:02:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:02:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:02:14 [WARNING ] (13, 1, 'bot')
2018-10-26 03:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:02:14 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-26 03:02:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 03:02:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:03:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:03:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:03:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:03:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:03:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:03:15 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-26 03:03:24 [DEBUG   ] Got command RPT from MCS: ref #273440
2018-10-26 03:03:24 [DEBUG   ] summary = ERROR
2018-10-26 03:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273440  13 58417 11004421 A  ERRORERROR'
2018-10-26 03:03:24 [DEBUG   ] Got command RPT from MCS: ref #273441
2018-10-26 03:03:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273441  77 58417 11004625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:03:24 [DEBUG   ] Got command RPT from MCS: ref #273442
2018-10-26 03:03:24 [DEBUG   ] summary = ERROR
2018-10-26 03:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273442  13 58417 11004829 A  ERRORERROR'
2018-10-26 03:03:25 [DEBUG   ] Got command RPT from MCS: ref #273444
2018-10-26 03:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273444  77 58417 11005021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:03:25 [DEBUG   ] Got command RPT from MCS: ref #273445
2018-10-26 03:03:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273445  12 58417 11005225 A  ERRORB•™š'
2018-10-26 03:03:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 03:03:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:04:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:04:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:04:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:04:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:04:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:04:15 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-26 03:04:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:04:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:05:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:05:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:05:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:05:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:05:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:05:15 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 03:05:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:05:37 [DEBUG   ] Got command RPT from MCS: ref #273454
2018-10-26 03:05:37 [DEBUG   ] summary = ERROR
2018-10-26 03:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273454  13 58417 11137249 A  ERRORERROR'
2018-10-26 03:05:37 [DEBUG   ] Got command RPT from MCS: ref #273455
2018-10-26 03:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273455  77 58417 11137250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:05:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 03:06:09 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-26 03:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:06:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:06:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:06:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:06:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:06:15 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 03:06:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 03:06:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:07:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 03:07:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:07:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:07:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:07:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:07:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:07:15 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-26 03:07:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 03:07:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 03:08:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:08:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:08:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:08:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:08:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:08:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:08:15 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-26 03:08:24 [DEBUG   ] Got command RPT from MCS: ref #273475
2018-10-26 03:08:24 [DEBUG   ] summary = ERROR
2018-10-26 03:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273475  13 58417 11304513 A  ERRORERROR'
2018-10-26 03:08:24 [DEBUG   ] Got command RPT from MCS: ref #273476
2018-10-26 03:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273476  77 58417 11304705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:08:24 [DEBUG   ] Got command RPT from MCS: ref #273477
2018-10-26 03:08:24 [DEBUG   ] summary = ERROR
2018-10-26 03:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273477  13 58417 11304909 A  ERRORERROR'
2018-10-26 03:08:25 [DEBUG   ] Got command RPT from MCS: ref #273478
2018-10-26 03:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273478  77 58417 11305113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:08:25 [DEBUG   ] Got command RPT from MCS: ref #273479
2018-10-26 03:08:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273479  12 58417 11305305 A  ERRORB•™š'
2018-10-26 03:08:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 03:08:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 03:09:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:09:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:09:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:09:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:09:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:09:15 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-26 03:09:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:09:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 03:10:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:10:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 03:10:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:10:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:10:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:10:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:10:15 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-26 03:10:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 03:10:37 [DEBUG   ] Got command RPT from MCS: ref #273480
2018-10-26 03:10:37 [DEBUG   ] summary = ERROR
2018-10-26 03:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273480  13 58417 11437261 A  ERRORERROR'
2018-10-26 03:10:37 [DEBUG   ] Got command RPT from MCS: ref #273481
2018-10-26 03:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273481  77 58417 11437262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:10:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 03:11:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 03:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 03:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:11:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:11:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:11:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:11:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:11:15 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-26 03:11:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:11:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 03:12:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 03:12:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 03:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 03:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:12:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:12:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:12:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:12:15 [WARNING ] (13, 1, 'bot')
2018-10-26 03:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:12:15 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-26 03:12:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 03:12:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:13:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 03:13:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 03:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:13:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:13:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:13:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:13:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:13:16 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-10-26 03:13:24 [DEBUG   ] Got command RPT from MCS: ref #273503
2018-10-26 03:13:24 [DEBUG   ] summary = ERROR
2018-10-26 03:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273503  13 58417 11604589 A  ERRORERROR'
2018-10-26 03:13:24 [DEBUG   ] Got command RPT from MCS: ref #273504
2018-10-26 03:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273504  77 58417 11604793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:13:24 [DEBUG   ] Got command RPT from MCS: ref #273505
2018-10-26 03:13:24 [DEBUG   ] summary = ERROR
2018-10-26 03:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273505  13 58417 11604997 A  ERRORERROR'
2018-10-26 03:13:25 [DEBUG   ] Got command RPT from MCS: ref #273507
2018-10-26 03:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273507  77 58417 11605189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:13:25 [DEBUG   ] Got command RPT from MCS: ref #273508
2018-10-26 03:13:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273508  12 58417 11605393 A  ERRORB—™š'
2018-10-26 03:13:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 03:13:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 03:14:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:14:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:14:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:14:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:14:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:14:16 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-10-26 03:14:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:14:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 03:15:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:15:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 03:15:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:15:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:15:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:15:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:15:16 [DEBUG   ] Finished updating board flags in 2.173 seconds
2018-10-26 03:15:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:15:37 [DEBUG   ] Got command RPT from MCS: ref #273517
2018-10-26 03:15:37 [DEBUG   ] summary = ERROR
2018-10-26 03:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273517  13 58417 11737257 A  ERRORERROR'
2018-10-26 03:15:37 [DEBUG   ] Got command RPT from MCS: ref #273518
2018-10-26 03:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273518  77 58417 11737258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:15:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 03:16:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:16:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:16:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:16:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:16:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:16:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:16:16 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-10-26 03:16:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:16:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:17:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 03:17:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 03:17:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:17:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:17:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:17:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:17:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:17:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:17:16 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-26 03:17:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:17:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:18:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 03:18:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:18:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:18:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:18:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:18:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:18:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:18:16 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 03:18:24 [DEBUG   ] Got command RPT from MCS: ref #273538
2018-10-26 03:18:24 [DEBUG   ] summary = ERROR
2018-10-26 03:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273538  13 58417 11904673 A  ERRORERROR'
2018-10-26 03:18:24 [DEBUG   ] Got command RPT from MCS: ref #273539
2018-10-26 03:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273539  77 58417 11904877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:18:25 [DEBUG   ] Got command RPT from MCS: ref #273540
2018-10-26 03:18:25 [DEBUG   ] summary = ERROR
2018-10-26 03:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273540  13 58417 11905081 A  ERRORERROR'
2018-10-26 03:18:25 [DEBUG   ] Got command RPT from MCS: ref #273541
2018-10-26 03:18:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273541  77 58417 11905273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:18:25 [DEBUG   ] Got command RPT from MCS: ref #273542
2018-10-26 03:18:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273542  12 58417 11905477 A  ERRORB—™š'
2018-10-26 03:18:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 03:18:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:19:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:19:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:19:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:19:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:19:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:19:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:19:16 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-26 03:19:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:19:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 03:20:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 03:20:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:20:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:20:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:20:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:20:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-26 03:20:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:20:37 [DEBUG   ] Got command RPT from MCS: ref #273547
2018-10-26 03:20:37 [DEBUG   ] summary = ERROR
2018-10-26 03:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273547  13 58417 12037253 A  ERRORERROR'
2018-10-26 03:20:37 [DEBUG   ] Got command RPT from MCS: ref #273548
2018-10-26 03:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273548  77 58417 12037254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:20:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 03:21:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:21:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:21:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:21:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:21:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:21:16 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 03:21:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 03:21:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:22:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:22:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:22:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:22:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:22:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:22:16 [WARNING ] (13, 1, 'bot')
2018-10-26 03:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:22:16 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-10-26 03:22:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:22:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:23:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:23:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:23:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:23:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:23:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:23:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:23:17 [DEBUG   ] Finished updating board flags in 2.118 seconds
2018-10-26 03:23:24 [DEBUG   ] Got command RPT from MCS: ref #273570
2018-10-26 03:23:24 [DEBUG   ] summary = ERROR
2018-10-26 03:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273570  13 58417 12204757 A  ERRORERROR'
2018-10-26 03:23:24 [DEBUG   ] Got command RPT from MCS: ref #273571
2018-10-26 03:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273571  77 58417 12204961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:23:25 [DEBUG   ] Got command RPT from MCS: ref #273572
2018-10-26 03:23:25 [DEBUG   ] summary = ERROR
2018-10-26 03:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273572  13 58417 12205165 A  ERRORERROR'
2018-10-26 03:23:25 [DEBUG   ] Got command RPT from MCS: ref #273573
2018-10-26 03:23:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273573  77 58417 12205357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:23:25 [DEBUG   ] Got command RPT from MCS: ref #273575
2018-10-26 03:23:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273575  12 58417 12205561 A  ERRORB–™š'
2018-10-26 03:23:31 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-26 03:23:52 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 03:24:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 03:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:24:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 03:24:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:24:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:24:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:24:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:24:17 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 03:24:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:24:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 03:25:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:25:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:25:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 03:25:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:25:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:25:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:25:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:25:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:25:17 [DEBUG   ] Finished updating board flags in 1.746 seconds
2018-10-26 03:25:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:25:37 [DEBUG   ] Got command RPT from MCS: ref #273580
2018-10-26 03:25:37 [DEBUG   ] summary = ERROR
2018-10-26 03:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273580  13 58417 12337261 A  ERRORERROR'
2018-10-26 03:25:37 [DEBUG   ] Got command RPT from MCS: ref #273581
2018-10-26 03:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273581  77 58417 12337262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:25:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:26:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 03:26:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:26:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:26:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:26:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:26:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:26:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:26:17 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-26 03:26:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 03:26:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:27:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:27:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:27:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:27:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:27:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:27:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:27:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:27:17 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-26 03:27:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:27:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:28:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 03:28:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:28:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:28:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:28:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:28:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:28:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:28:17 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-26 03:28:24 [DEBUG   ] Got command RPT from MCS: ref #273601
2018-10-26 03:28:24 [DEBUG   ] summary = ERROR
2018-10-26 03:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273601  13 58417 12504853 A  ERRORERROR'
2018-10-26 03:28:25 [DEBUG   ] Got command RPT from MCS: ref #273602
2018-10-26 03:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273602  77 58417 12505045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:28:25 [DEBUG   ] Got command RPT from MCS: ref #273603
2018-10-26 03:28:25 [DEBUG   ] summary = ERROR
2018-10-26 03:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273603  13 58417 12505249 A  ERRORERROR'
2018-10-26 03:28:25 [DEBUG   ] Got command RPT from MCS: ref #273604
2018-10-26 03:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273604  77 58417 12505453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:28:25 [DEBUG   ] Got command RPT from MCS: ref #273605
2018-10-26 03:28:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273605  12 58417 12505657 A  ERRORB•™š'
2018-10-26 03:28:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 03:28:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 03:29:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:29:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:29:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:29:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:29:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:29:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:29:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:29:17 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-26 03:29:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:29:53 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2018-10-26 03:30:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 03:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 03:30:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:30:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:30:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:30:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:30:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:30:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:30:17 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-26 03:30:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:30:37 [DEBUG   ] Got command RPT from MCS: ref #273610
2018-10-26 03:30:37 [DEBUG   ] summary = ERROR
2018-10-26 03:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273610  13 58417 12637265 A  ERRORERROR'
2018-10-26 03:30:37 [DEBUG   ] Got command RPT from MCS: ref #273611
2018-10-26 03:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273611  77 58417 12637266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:30:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 03:31:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 03:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:31:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:31:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:31:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:31:17 [WARNING ] (13, 1, 'bot')
2018-10-26 03:31:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:31:17 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-10-26 03:31:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:31:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:32:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:32:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:32:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 03:32:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:32:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:32:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:32:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:32:18 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-10-26 03:32:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 03:32:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:33:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 03:33:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:33:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 03:33:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:33:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:33:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:33:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:33:18 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 03:33:24 [DEBUG   ] Got command RPT from MCS: ref #273633
2018-10-26 03:33:24 [DEBUG   ] summary = ERROR
2018-10-26 03:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273633  13 58417 12804941 A  ERRORERROR'
2018-10-26 03:33:25 [DEBUG   ] Got command RPT from MCS: ref #273634
2018-10-26 03:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273634  77 58417 12805133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:33:25 [DEBUG   ] Got command RPT from MCS: ref #273635
2018-10-26 03:33:25 [DEBUG   ] summary = ERROR
2018-10-26 03:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273635  13 58417 12805337 A  ERRORERROR'
2018-10-26 03:33:25 [DEBUG   ] Got command RPT from MCS: ref #273636
2018-10-26 03:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273636  77 58417 12805541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:33:25 [DEBUG   ] Got command RPT from MCS: ref #273638
2018-10-26 03:33:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273638  12 58417 12805733 A  ERRORB—™š'
2018-10-26 03:33:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 03:33:54 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-10-26 03:34:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:34:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 03:34:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:34:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:34:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:34:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:34:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:34:18 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 03:34:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 03:34:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:35:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:35:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:35:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:35:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:35:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:35:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:35:18 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 03:35:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 03:35:37 [DEBUG   ] Got command RPT from MCS: ref #273647
2018-10-26 03:35:37 [DEBUG   ] summary = ERROR
2018-10-26 03:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273647  13 58417 12937265 A  ERRORERROR'
2018-10-26 03:35:37 [DEBUG   ] Got command RPT from MCS: ref #273648
2018-10-26 03:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273648  77 58417 12937266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:35:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 03:36:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 03:36:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:36:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:36:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:36:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:36:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:36:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:36:18 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-26 03:36:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 03:36:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:37:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 03:37:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:37:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:37:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:37:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:37:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:37:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:37:18 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-10-26 03:37:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:37:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:38:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:38:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:38:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:38:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:38:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:38:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:38:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:38:18 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-26 03:38:25 [DEBUG   ] Got command RPT from MCS: ref #273668
2018-10-26 03:38:25 [DEBUG   ] summary = ERROR
2018-10-26 03:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273668  13 58417 13105017 A  ERRORERROR'
2018-10-26 03:38:25 [DEBUG   ] Got command RPT from MCS: ref #273669
2018-10-26 03:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273669  77 58417 13105221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:38:25 [DEBUG   ] Got command RPT from MCS: ref #273670
2018-10-26 03:38:25 [DEBUG   ] summary = ERROR
2018-10-26 03:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273670  13 58417 13105425 A  ERRORERROR'
2018-10-26 03:38:25 [DEBUG   ] Got command RPT from MCS: ref #273671
2018-10-26 03:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273671  77 58417 13105617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:38:25 [DEBUG   ] Got command RPT from MCS: ref #273672
2018-10-26 03:38:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273672  12 58417 13105821 A  ERRORB—™š'
2018-10-26 03:38:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:38:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-26 03:39:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:39:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:39:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:39:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:39:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:39:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:39:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:39:18 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-26 03:39:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 03:39:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 03:40:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:40:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:40:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:40:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:40:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:40:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:40:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:40:18 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-26 03:40:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 03:40:37 [DEBUG   ] Got command RPT from MCS: ref #273673
2018-10-26 03:40:37 [DEBUG   ] summary = ERROR
2018-10-26 03:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273673  13 58417 13237265 A  ERRORERROR'
2018-10-26 03:40:37 [DEBUG   ] Got command RPT from MCS: ref #273674
2018-10-26 03:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273674  77 58417 13237266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:40:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 03:41:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:41:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:41:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:41:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:41:18 [WARNING ] (13, 1, 'bot')
2018-10-26 03:41:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:41:18 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-26 03:41:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:41:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:42:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 03:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:42:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:42:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:42:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:42:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:42:19 [DEBUG   ] Finished updating board flags in 2.077 seconds
2018-10-26 03:42:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:42:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:43:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:43:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-10-26 03:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:43:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:43:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:43:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:43:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:43:19 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-10-26 03:43:25 [DEBUG   ] Got command RPT from MCS: ref #273696
2018-10-26 03:43:25 [DEBUG   ] summary = ERROR
2018-10-26 03:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273696  13 58417 13405101 A  ERRORERROR'
2018-10-26 03:43:25 [DEBUG   ] Got command RPT from MCS: ref #273697
2018-10-26 03:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273697  77 58417 13405305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:43:25 [DEBUG   ] Got command RPT from MCS: ref #273698
2018-10-26 03:43:25 [DEBUG   ] summary = ERROR
2018-10-26 03:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273698  13 58417 13405509 A  ERRORERROR'
2018-10-26 03:43:25 [DEBUG   ] Got command RPT from MCS: ref #273699
2018-10-26 03:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273699  77 58417 13405713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:43:25 [DEBUG   ] Got command RPT from MCS: ref #273701
2018-10-26 03:43:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273701  12 58417 13405905 A  ERRORB–™š'
2018-10-26 03:43:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 03:43:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:44:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:44:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:44:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:44:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:44:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:44:19 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-26 03:44:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:44:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:45:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 03:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:45:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:45:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:45:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:45:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:45:19 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-26 03:45:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 03:45:37 [DEBUG   ] Got command RPT from MCS: ref #273710
2018-10-26 03:45:37 [DEBUG   ] summary = ERROR
2018-10-26 03:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273710  13 58417 13537269 A  ERRORERROR'
2018-10-26 03:45:37 [DEBUG   ] Got command RPT from MCS: ref #273711
2018-10-26 03:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273711  77 58417 13537270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:45:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 03:46:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:46:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:46:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:46:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:46:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:46:19 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-26 03:46:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:46:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:47:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 03:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:47:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:47:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:47:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:47:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:47:19 [DEBUG   ] Finished updating board flags in 1.835 seconds
2018-10-26 03:47:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 03:47:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 03:48:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:48:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:48:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:48:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:48:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:48:19 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-10-26 03:48:25 [DEBUG   ] Got command RPT from MCS: ref #273731
2018-10-26 03:48:25 [DEBUG   ] summary = ERROR
2018-10-26 03:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273731  13 58417 13705189 A  ERRORERROR'
2018-10-26 03:48:25 [DEBUG   ] Got command RPT from MCS: ref #273732
2018-10-26 03:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273732  77 58417 13705393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:48:25 [DEBUG   ] Got command RPT from MCS: ref #273733
2018-10-26 03:48:25 [DEBUG   ] summary = ERROR
2018-10-26 03:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273733  13 58417 13705597 A  ERRORERROR'
2018-10-26 03:48:25 [DEBUG   ] Got command RPT from MCS: ref #273734
2018-10-26 03:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273734  77 58417 13705789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:48:25 [DEBUG   ] Got command RPT from MCS: ref #273735
2018-10-26 03:48:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273735  12 58417 13705993 A  ERRORB•™š'
2018-10-26 03:48:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 03:48:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:49:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 03:49:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:49:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 03:49:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:49:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:49:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:49:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:49:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:49:19 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-26 03:49:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:49:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 03:50:17 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 03:50:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:50:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:50:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:50:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:50:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:50:19 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-26 03:50:37 [DEBUG   ] Got command RPT from MCS: ref #273740
2018-10-26 03:50:37 [DEBUG   ] summary = ERROR
2018-10-26 03:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273740  13 58417 13837261 A  ERRORERROR'
2018-10-26 03:50:37 [DEBUG   ] Got command RPT from MCS: ref #273741
2018-10-26 03:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273741  77 58417 13837262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:50:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 03:50:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 03:51:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:51:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:51:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:51:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:51:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:51:19 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-26 03:51:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:51:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 03:52:00 [DEBUG   ] Got command TBN from MCS: ref #273757
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-26 03:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   273757   8 58417 13920441 A  ERROR'
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540525921']
2018-10-26 03:52:00 [DEBUG   ] spawn_process: at 2018-10-26 03:52:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540525921']
2018-10-26 03:52:00 [INFO    ] Finished spawning TBN in 0.058 s
2018-10-26 03:52:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 03:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:52:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:52:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:52:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:52:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:52:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:52:19 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 03:52:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 03:52:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 03:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 03:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:53:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:53:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:53:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:53:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:53:19 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 03:53:25 [DEBUG   ] Got command RPT from MCS: ref #273764
2018-10-26 03:53:25 [DEBUG   ] summary = ERROR
2018-10-26 03:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273764  13 58417 14005277 A  ERRORERROR'
2018-10-26 03:53:25 [DEBUG   ] Got command RPT from MCS: ref #273765
2018-10-26 03:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273765  77 58417 14005481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:53:25 [DEBUG   ] Got command RPT from MCS: ref #273766
2018-10-26 03:53:25 [DEBUG   ] summary = ERROR
2018-10-26 03:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273766  13 58417 14005673 A  ERRORERROR'
2018-10-26 03:53:25 [DEBUG   ] Got command RPT from MCS: ref #273768
2018-10-26 03:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273768  77 58417 14005877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:53:26 [DEBUG   ] Got command RPT from MCS: ref #273769
2018-10-26 03:53:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273769  12 58417 14006081 A  ERRORB”™š'
2018-10-26 03:53:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:53:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 03:54:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 03:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:54:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:54:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:54:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:54:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:54:19 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-26 03:54:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:54:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 03:55:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 03:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:55:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:55:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:55:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:55:19 [WARNING ] (13, 1, 'bot')
2018-10-26 03:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:55:19 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-26 03:55:37 [DEBUG   ] Got command RPT from MCS: ref #273774
2018-10-26 03:55:37 [DEBUG   ] summary = ERROR
2018-10-26 03:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273774  13 58417 14137266 A  ERRORERROR'
2018-10-26 03:55:37 [DEBUG   ] Got command RPT from MCS: ref #273775
2018-10-26 03:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273775  77 58417 14137266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:55:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 03:55:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 03:56:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 03:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:56:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:56:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:56:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:56:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:56:20 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-10-26 03:56:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 03:56:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 03:57:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:57:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:57:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:57:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:57:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:57:20 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-10-26 03:57:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:57:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 03:58:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 03:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:58:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:58:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:58:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:58:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:58:20 [DEBUG   ] Finished updating board flags in 1.852 seconds
2018-10-26 03:58:25 [DEBUG   ] Got command RPT from MCS: ref #273795
2018-10-26 03:58:25 [DEBUG   ] summary = ERROR
2018-10-26 03:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273795  13 58417 14305365 A  ERRORERROR'
2018-10-26 03:58:25 [DEBUG   ] Got command RPT from MCS: ref #273796
2018-10-26 03:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273796  77 58417 14305569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:58:25 [DEBUG   ] Got command RPT from MCS: ref #273797
2018-10-26 03:58:25 [DEBUG   ] summary = ERROR
2018-10-26 03:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273797  13 58417 14305761 A  ERRORERROR'
2018-10-26 03:58:25 [DEBUG   ] Got command RPT from MCS: ref #273798
2018-10-26 03:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 03:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273798  77 58417 14305965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 03:58:26 [DEBUG   ] Got command RPT from MCS: ref #273799
2018-10-26 03:58:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 03:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273799  12 58417 14306169 A  ERRORB”™š'
2018-10-26 03:58:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 03:58:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 03:59:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:59:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 03:59:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:59:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:59:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:59:20 [WARNING ] (13, 1, 'bot')
2018-10-26 03:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 03:59:20 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-10-26 03:59:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 03:59:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 04:00:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-26 04:00:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:00:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:00:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:00:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:00:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:00:20 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-26 04:00:37 [DEBUG   ] Got command RPT from MCS: ref #273804
2018-10-26 04:00:37 [DEBUG   ] summary = ERROR
2018-10-26 04:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273804  13 58417 14437265 A  ERRORERROR'
2018-10-26 04:00:37 [DEBUG   ] Got command RPT from MCS: ref #273805
2018-10-26 04:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273805  77 58417 14437266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:00:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:00:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:01:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 04:01:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:01:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:01:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:01:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:01:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:01:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:01:20 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-26 04:01:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 04:01:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:02:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:02:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:02:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:02:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:02:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:02:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:02:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:02:20 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-26 04:02:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 04:02:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 04:03:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 04:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:03:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:03:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:03:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:03:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:03:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:03:20 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-10-26 04:03:25 [DEBUG   ] Got command RPT from MCS: ref #273827
2018-10-26 04:03:25 [DEBUG   ] summary = ERROR
2018-10-26 04:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273827  13 58417 14605457 A  ERRORERROR'
2018-10-26 04:03:25 [DEBUG   ] Got command RPT from MCS: ref #273828
2018-10-26 04:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273828  77 58417 14605649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:03:25 [DEBUG   ] Got command RPT from MCS: ref #273829
2018-10-26 04:03:25 [DEBUG   ] summary = ERROR
2018-10-26 04:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273829  13 58417 14605853 A  ERRORERROR'
2018-10-26 04:03:26 [DEBUG   ] Got command RPT from MCS: ref #273831
2018-10-26 04:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273831  77 58417 14606057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:03:26 [DEBUG   ] Got command RPT from MCS: ref #273832
2018-10-26 04:03:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273832  12 58417 14606249 A  ERRORB–™š'
2018-10-26 04:03:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 04:03:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 04:04:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:04:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:04:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:04:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:04:20 [WARNING ] (13, 1, 'bot')
2018-10-26 04:04:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:04:20 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-26 04:04:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:04:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:05:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:05:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:05:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:05:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:05:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:05:21 [DEBUG   ] Finished updating board flags in 2.155 seconds
2018-10-26 04:05:37 [DEBUG   ] Got command RPT from MCS: ref #273841
2018-10-26 04:05:37 [DEBUG   ] summary = ERROR
2018-10-26 04:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273841  13 58417 14737265 A  ERRORERROR'
2018-10-26 04:05:37 [DEBUG   ] Got command RPT from MCS: ref #273842
2018-10-26 04:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273842  77 58417 14737266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:05:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:05:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:06:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:06:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:06:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:06:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:06:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:06:21 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-26 04:06:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:06:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:07:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:07:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 04:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:07:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:07:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:07:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:07:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:07:21 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-26 04:07:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:07:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 04:08:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 04:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:08:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:08:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:08:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:08:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:08:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:08:21 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-26 04:08:25 [DEBUG   ] Got command RPT from MCS: ref #273862
2018-10-26 04:08:25 [DEBUG   ] summary = ERROR
2018-10-26 04:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273862  13 58417 14905541 A  ERRORERROR'
2018-10-26 04:08:25 [DEBUG   ] Got command RPT from MCS: ref #273863
2018-10-26 04:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273863  77 58417 14905733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:08:25 [DEBUG   ] Got command RPT from MCS: ref #273864
2018-10-26 04:08:25 [DEBUG   ] summary = ERROR
2018-10-26 04:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273864  13 58417 14905937 A  ERRORERROR'
2018-10-26 04:08:26 [DEBUG   ] Got command RPT from MCS: ref #273865
2018-10-26 04:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273865  77 58417 14906141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:08:26 [DEBUG   ] Got command RPT from MCS: ref #273866
2018-10-26 04:08:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273866  12 58417 14906345 A  ERRORB–™š'
2018-10-26 04:08:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:08:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 04:09:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 04:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:09:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:09:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:09:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:09:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:09:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:09:21 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-26 04:09:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 04:10:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 04:10:20 [DEBUG   ] Finished updating ant stats in 1.241 seconds
2018-10-26 04:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:10:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:10:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:10:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:10:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:10:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:10:21 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-26 04:10:37 [DEBUG   ] Got command RPT from MCS: ref #273867
2018-10-26 04:10:37 [DEBUG   ] summary = ERROR
2018-10-26 04:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273867  13 58417 15037265 A  ERRORERROR'
2018-10-26 04:10:37 [DEBUG   ] Got command RPT from MCS: ref #273868
2018-10-26 04:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273868  77 58417 15037266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:10:40 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-10-26 04:11:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:11:20 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2018-10-26 04:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:11:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:11:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:11:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:11:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:11:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:11:21 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-26 04:11:40 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-10-26 04:12:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:12:20 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2018-10-26 04:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:12:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:12:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:12:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:12:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:12:21 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-26 04:12:40 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-10-26 04:13:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 04:13:20 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-10-26 04:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:13:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:13:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:13:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:13:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:13:21 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-26 04:13:25 [DEBUG   ] Got command RPT from MCS: ref #273890
2018-10-26 04:13:25 [DEBUG   ] summary = ERROR
2018-10-26 04:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273890  13 58417 15205617 A  ERRORERROR'
2018-10-26 04:13:25 [DEBUG   ] Got command RPT from MCS: ref #273891
2018-10-26 04:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273891  77 58417 15205821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:13:26 [DEBUG   ] Got command RPT from MCS: ref #273892
2018-10-26 04:13:26 [DEBUG   ] summary = ERROR
2018-10-26 04:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273892  13 58417 15206030 A  ERRORERROR'
2018-10-26 04:13:26 [DEBUG   ] Got command RPT from MCS: ref #273894
2018-10-26 04:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273894  77 58417 15206221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:13:26 [DEBUG   ] Got command RPT from MCS: ref #273895
2018-10-26 04:13:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273895  12 58417 15206425 A  ERRORB–™š'
2018-10-26 04:13:41 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2018-10-26 04:14:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 04:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:14:21 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-26 04:14:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:14:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:14:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:14:21 [WARNING ] (13, 1, 'bot')
2018-10-26 04:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:14:21 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-26 04:14:41 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-10-26 04:15:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 04:15:21 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-10-26 04:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:15:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:15:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:15:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:15:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:15:22 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-10-26 04:15:37 [DEBUG   ] Got command RPT from MCS: ref #273904
2018-10-26 04:15:37 [DEBUG   ] summary = ERROR
2018-10-26 04:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273904  13 58417 15337277 A  ERRORERROR'
2018-10-26 04:15:37 [DEBUG   ] Got command RPT from MCS: ref #273905
2018-10-26 04:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273905  77 58417 15337278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:15:41 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-10-26 04:16:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 04:16:21 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-10-26 04:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:16:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:16:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:16:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:16:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:16:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:16:22 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-26 04:16:41 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-10-26 04:17:01 [DEBUG   ] Finished updating ant stats in 0.476 seconds
2018-10-26 04:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:17:22 [DEBUG   ] Finished updating ant stats in 1.371 seconds
2018-10-26 04:17:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:17:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:17:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:17:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:17:22 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-26 04:17:42 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-10-26 04:18:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:18:22 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-26 04:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:18:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:18:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:18:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:18:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:18:23 [DEBUG   ] Finished updating board flags in 2.950 seconds
2018-10-26 04:18:25 [DEBUG   ] Got command RPT from MCS: ref #273925
2018-10-26 04:18:25 [DEBUG   ] summary = ERROR
2018-10-26 04:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273925  13 58417 15505705 A  ERRORERROR'
2018-10-26 04:18:25 [DEBUG   ] Got command RPT from MCS: ref #273926
2018-10-26 04:18:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273926  77 58417 15505909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:18:26 [DEBUG   ] Got command RPT from MCS: ref #273927
2018-10-26 04:18:26 [DEBUG   ] summary = ERROR
2018-10-26 04:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273927  13 58417 15506113 A  ERRORERROR'
2018-10-26 04:18:26 [DEBUG   ] Got command RPT from MCS: ref #273928
2018-10-26 04:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273928  77 58417 15506317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:18:26 [DEBUG   ] Got command RPT from MCS: ref #273929
2018-10-26 04:18:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273929  12 58417 15506509 A  ERRORB•™š'
2018-10-26 04:18:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 04:19:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:19:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:19:22 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-10-26 04:19:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:19:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:19:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:19:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:19:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:19:22 [DEBUG   ] Finished updating board flags in 1.854 seconds
2018-10-26 04:19:42 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-10-26 04:20:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 04:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:20:22 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-10-26 04:20:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-26 04:20:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:20:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:20:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:20:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:20:22 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-26 04:20:37 [DEBUG   ] Got command RPT from MCS: ref #273934
2018-10-26 04:20:37 [DEBUG   ] summary = ERROR
2018-10-26 04:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273934  13 58417 15637273 A  ERRORERROR'
2018-10-26 04:20:37 [DEBUG   ] Got command RPT from MCS: ref #273935
2018-10-26 04:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273935  77 58417 15637274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:20:43 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-10-26 04:21:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:21:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:21:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:21:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:21:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:21:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:21:22 [DEBUG   ] Finished updating board flags in 1.756 seconds
2018-10-26 04:21:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:21:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:22:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:22:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:22:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:22:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:22:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:22:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:22:22 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-26 04:22:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:22:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:23:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:23:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:23:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:23:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:23:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:23:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:23:22 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-26 04:23:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:23:25 [DEBUG   ] Got command RPT from MCS: ref #273957
2018-10-26 04:23:25 [DEBUG   ] summary = ERROR
2018-10-26 04:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273957  13 58417 15805793 A  ERRORERROR'
2018-10-26 04:23:25 [DEBUG   ] Got command RPT from MCS: ref #273958
2018-10-26 04:23:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273958  77 58417 15805997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:23:26 [DEBUG   ] Got command RPT from MCS: ref #273959
2018-10-26 04:23:26 [DEBUG   ] summary = ERROR
2018-10-26 04:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273959  13 58417 15806201 A  ERRORERROR'
2018-10-26 04:23:26 [DEBUG   ] Got command RPT from MCS: ref #273961
2018-10-26 04:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273961  77 58417 15806393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:23:26 [DEBUG   ] Got command RPT from MCS: ref #273962
2018-10-26 04:23:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273962  12 58417 15806597 A  ERRORB•™š'
2018-10-26 04:23:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:24:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:24:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:24:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:24:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:24:22 [WARNING ] (13, 1, 'bot')
2018-10-26 04:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:24:22 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-26 04:24:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:24:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:25:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:25:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:25:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:25:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:25:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:25:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:25:23 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-26 04:25:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:25:37 [DEBUG   ] Got command RPT from MCS: ref #273967
2018-10-26 04:25:37 [DEBUG   ] summary = ERROR
2018-10-26 04:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273967  13 58417 15937269 A  ERRORERROR'
2018-10-26 04:25:37 [DEBUG   ] Got command RPT from MCS: ref #273968
2018-10-26 04:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273968  77 58417 15937270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:25:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:26:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:26:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:26:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:26:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:26:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:26:23 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-10-26 04:26:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 04:26:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:27:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:27:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:27:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:27:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:27:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:27:23 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-10-26 04:27:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:27:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:28:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:28:23 [DEBUG   ] Finished updating ant stats in 1.055 seconds
2018-10-26 04:28:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:28:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:28:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:28:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:28:23 [DEBUG   ] Finished updating board flags in 2.351 seconds
2018-10-26 04:28:25 [DEBUG   ] Got command RPT from MCS: ref #273988
2018-10-26 04:28:25 [DEBUG   ] summary = ERROR
2018-10-26 04:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273988  13 58417 16105885 A  ERRORERROR'
2018-10-26 04:28:26 [DEBUG   ] Got command RPT from MCS: ref #273989
2018-10-26 04:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273989  77 58417 16106077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:28:26 [DEBUG   ] Got command RPT from MCS: ref #273990
2018-10-26 04:28:26 [DEBUG   ] summary = ERROR
2018-10-26 04:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273990  13 58417 16106281 A  ERRORERROR'
2018-10-26 04:28:26 [DEBUG   ] Got command RPT from MCS: ref #273991
2018-10-26 04:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273991  77 58417 16106485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:28:26 [DEBUG   ] Got command RPT from MCS: ref #273992
2018-10-26 04:28:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273992  12 58417 16106677 A  ERRORB•™š'
2018-10-26 04:28:43 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-10-26 04:29:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 04:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:29:23 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2018-10-26 04:29:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:29:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:29:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:29:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:29:23 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-10-26 04:29:43 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2018-10-26 04:30:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:30:23 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-10-26 04:30:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:30:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:30:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:30:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:30:23 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-26 04:30:37 [DEBUG   ] Got command RPT from MCS: ref #273997
2018-10-26 04:30:37 [DEBUG   ] summary = ERROR
2018-10-26 04:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273997  13 58417 16237273 A  ERRORERROR'
2018-10-26 04:30:37 [DEBUG   ] Got command RPT from MCS: ref #273998
2018-10-26 04:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   273998  77 58417 16237274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:30:43 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-10-26 04:31:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 04:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:31:23 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-10-26 04:31:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:31:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:31:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:31:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:31:23 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-26 04:31:44 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2018-10-26 04:32:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:32:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:32:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:32:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:32:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:32:23 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-10-26 04:32:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:32:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:33:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:33:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:33:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:33:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:33:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:33:23 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-10-26 04:33:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:33:25 [DEBUG   ] Got command RPT from MCS: ref #274020
2018-10-26 04:33:25 [DEBUG   ] summary = ERROR
2018-10-26 04:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274020  13 58417 16405961 A  ERRORERROR'
2018-10-26 04:33:26 [DEBUG   ] Got command RPT from MCS: ref #274021
2018-10-26 04:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274021  77 58417 16406165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:33:26 [DEBUG   ] Got command RPT from MCS: ref #274022
2018-10-26 04:33:26 [DEBUG   ] summary = ERROR
2018-10-26 04:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274022  13 58417 16406369 A  ERRORERROR'
2018-10-26 04:33:26 [DEBUG   ] Got command RPT from MCS: ref #274024
2018-10-26 04:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274024  77 58417 16406573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:33:26 [DEBUG   ] Got command RPT from MCS: ref #274025
2018-10-26 04:33:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274025  12 58417 16406765 A  ERRORB•™š'
2018-10-26 04:33:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:34:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 04:34:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:34:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 04:34:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 04:34:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:34:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:34:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:34:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:34:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:34:24 [DEBUG   ] Finished updating board flags in 2.524 seconds
2018-10-26 04:34:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:35:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 04:35:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:35:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:35:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:35:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:35:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:35:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:35:23 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-26 04:35:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 04:35:37 [DEBUG   ] Got command RPT from MCS: ref #274034
2018-10-26 04:35:37 [DEBUG   ] summary = ERROR
2018-10-26 04:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274034  13 58417 16537281 A  ERRORERROR'
2018-10-26 04:35:37 [DEBUG   ] Got command RPT from MCS: ref #274035
2018-10-26 04:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274035  77 58417 16537282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:35:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:36:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:36:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:36:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:36:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:36:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:36:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:36:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:36:23 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 04:36:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 04:36:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 04:37:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:37:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:37:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:37:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:37:23 [WARNING ] (13, 1, 'bot')
2018-10-26 04:37:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:37:23 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-26 04:37:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 04:37:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-26 04:38:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 04:38:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 04:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:38:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:38:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:38:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:38:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:38:24 [DEBUG   ] Finished updating board flags in 2.244 seconds
2018-10-26 04:38:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 04:38:26 [DEBUG   ] Got command RPT from MCS: ref #274055
2018-10-26 04:38:26 [DEBUG   ] summary = ERROR
2018-10-26 04:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274055  13 58417 16706045 A  ERRORERROR'
2018-10-26 04:38:26 [DEBUG   ] Got command RPT from MCS: ref #274056
2018-10-26 04:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274056  77 58417 16706249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:38:26 [DEBUG   ] Got command RPT from MCS: ref #274057
2018-10-26 04:38:26 [DEBUG   ] summary = ERROR
2018-10-26 04:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274057  13 58417 16706453 A  ERRORERROR'
2018-10-26 04:38:26 [DEBUG   ] Got command RPT from MCS: ref #274058
2018-10-26 04:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274058  77 58417 16706657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:38:26 [DEBUG   ] Got command RPT from MCS: ref #274059
2018-10-26 04:38:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274059  12 58417 16706849 A  ERRORB—™š'
2018-10-26 04:38:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:39:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 04:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:39:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:39:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:39:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:39:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:39:24 [DEBUG   ] Finished updating board flags in 2.165 seconds
2018-10-26 04:39:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 04:39:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 04:40:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 04:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:40:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:40:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:40:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:40:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:40:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:40:24 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-26 04:40:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 04:40:37 [DEBUG   ] Got command RPT from MCS: ref #274060
2018-10-26 04:40:37 [DEBUG   ] summary = ERROR
2018-10-26 04:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274060  13 58417 16837273 A  ERRORERROR'
2018-10-26 04:40:37 [DEBUG   ] Got command RPT from MCS: ref #274061
2018-10-26 04:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274061  77 58417 16837274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:40:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:41:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 04:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 04:41:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:41:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:41:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:41:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:41:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:41:24 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-26 04:41:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 04:41:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 04:42:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:42:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:42:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:42:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:42:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:42:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:42:24 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-10-26 04:42:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:42:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:43:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 04:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 04:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:43:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:43:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:43:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:43:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:43:24 [DEBUG   ] Finished updating board flags in 1.713 seconds
2018-10-26 04:43:26 [DEBUG   ] Got command RPT from MCS: ref #274083
2018-10-26 04:43:26 [DEBUG   ] summary = ERROR
2018-10-26 04:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274083  13 58417 17006137 A  ERRORERROR'
2018-10-26 04:43:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 04:43:26 [DEBUG   ] Got command RPT from MCS: ref #274084
2018-10-26 04:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274084  77 58417 17006330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:43:26 [DEBUG   ] Got command RPT from MCS: ref #274085
2018-10-26 04:43:26 [DEBUG   ] summary = ERROR
2018-10-26 04:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274085  13 58417 17006534 A  ERRORERROR'
2018-10-26 04:43:26 [DEBUG   ] Got command RPT from MCS: ref #274087
2018-10-26 04:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274087  77 58417 17006737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:43:26 [DEBUG   ] Got command RPT from MCS: ref #274089
2018-10-26 04:43:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274089  12 58417 17006941 A  ERRORB—™š'
2018-10-26 04:43:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 04:44:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:44:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 04:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:44:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:44:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:44:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:44:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:44:24 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 04:44:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:44:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:45:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 04:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:45:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:45:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:45:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:45:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:45:24 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 04:45:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 04:45:37 [DEBUG   ] Got command RPT from MCS: ref #274097
2018-10-26 04:45:37 [DEBUG   ] summary = ERROR
2018-10-26 04:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274097  13 58417 17137281 A  ERRORERROR'
2018-10-26 04:45:37 [DEBUG   ] Got command RPT from MCS: ref #274098
2018-10-26 04:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274098  77 58417 17137282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:45:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 04:46:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 04:46:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 04:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:46:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:46:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:46:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:46:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:46:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:46:24 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-26 04:46:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 04:46:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:47:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:47:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 04:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:47:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 04:47:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:47:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:47:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:47:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:47:24 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-26 04:47:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:47:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 04:48:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 04:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:48:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:48:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:48:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:48:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:48:24 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-26 04:48:26 [DEBUG   ] Got command RPT from MCS: ref #274118
2018-10-26 04:48:26 [DEBUG   ] summary = ERROR
2018-10-26 04:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274118  13 58417 17306225 A  ERRORERROR'
2018-10-26 04:48:26 [DEBUG   ] Got command RPT from MCS: ref #274119
2018-10-26 04:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274119  77 58417 17306417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:48:26 [DEBUG   ] Got command RPT from MCS: ref #274120
2018-10-26 04:48:26 [DEBUG   ] summary = ERROR
2018-10-26 04:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274120  13 58417 17306621 A  ERRORERROR'
2018-10-26 04:48:26 [DEBUG   ] Got command RPT from MCS: ref #274121
2018-10-26 04:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274121  77 58417 17306825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:48:27 [DEBUG   ] Got command RPT from MCS: ref #274122
2018-10-26 04:48:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274122  12 58417 17307029 A  ERRORB˜™š'
2018-10-26 04:48:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 04:48:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 04:49:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 04:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:49:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:49:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:49:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:49:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:49:24 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-26 04:49:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 04:49:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:50:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:50:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:50:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:50:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:50:24 [WARNING ] (13, 1, 'bot')
2018-10-26 04:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:50:24 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-10-26 04:50:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:50:37 [DEBUG   ] Got command RPT from MCS: ref #274127
2018-10-26 04:50:37 [DEBUG   ] summary = ERROR
2018-10-26 04:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274127  13 58417 17437285 A  ERRORERROR'
2018-10-26 04:50:37 [DEBUG   ] Got command RPT from MCS: ref #274128
2018-10-26 04:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274128  77 58417 17437286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:50:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:51:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 04:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:51:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:51:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:51:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:51:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:51:25 [DEBUG   ] Finished updating board flags in 2.096 seconds
2018-10-26 04:51:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 04:51:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:52:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:52:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 04:52:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:52:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:52:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:52:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:52:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:52:25 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-26 04:52:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:52:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:53:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:53:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:53:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:53:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:53:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:53:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:53:25 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-26 04:53:26 [DEBUG   ] Got command RPT from MCS: ref #274150
2018-10-26 04:53:26 [DEBUG   ] summary = ERROR
2018-10-26 04:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274150  13 58417 17606305 A  ERRORERROR'
2018-10-26 04:53:26 [DEBUG   ] Got command RPT from MCS: ref #274151
2018-10-26 04:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274151  77 58417 17606509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:53:26 [DEBUG   ] Got command RPT from MCS: ref #274152
2018-10-26 04:53:26 [DEBUG   ] summary = ERROR
2018-10-26 04:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274152  13 58417 17606714 A  ERRORERROR'
2018-10-26 04:53:26 [DEBUG   ] Got command RPT from MCS: ref #274154
2018-10-26 04:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274154  77 58417 17606905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:53:27 [DEBUG   ] Got command RPT from MCS: ref #274155
2018-10-26 04:53:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274155  12 58417 17607109 A  ERRORB˜™š'
2018-10-26 04:53:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:53:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:54:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 04:54:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:54:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:54:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:54:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:54:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:54:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:54:25 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-10-26 04:54:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:54:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 04:55:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 04:55:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:55:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:55:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:55:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:55:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:55:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:55:25 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-26 04:55:27 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 04:55:37 [DEBUG   ] Got command RPT from MCS: ref #274160
2018-10-26 04:55:37 [DEBUG   ] summary = ERROR
2018-10-26 04:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274160  13 58417 17737277 A  ERRORERROR'
2018-10-26 04:55:37 [DEBUG   ] Got command RPT from MCS: ref #274161
2018-10-26 04:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274161  77 58417 17737278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:55:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 04:56:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 04:56:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:56:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:56:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:56:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:56:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:56:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:56:25 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-26 04:56:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 04:56:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:57:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 04:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:57:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:57:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:57:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:57:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:57:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:57:25 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-26 04:57:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 04:57:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 04:58:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:58:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:58:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:58:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:58:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:58:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:58:25 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-26 04:58:26 [DEBUG   ] Got command RPT from MCS: ref #274181
2018-10-26 04:58:26 [DEBUG   ] summary = ERROR
2018-10-26 04:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274181  13 58417 17906397 A  ERRORERROR'
2018-10-26 04:58:26 [DEBUG   ] Got command RPT from MCS: ref #274182
2018-10-26 04:58:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274182  77 58417 17906589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:58:26 [DEBUG   ] Got command RPT from MCS: ref #274183
2018-10-26 04:58:26 [DEBUG   ] summary = ERROR
2018-10-26 04:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274183  13 58417 17906793 A  ERRORERROR'
2018-10-26 04:58:26 [DEBUG   ] Got command RPT from MCS: ref #274184
2018-10-26 04:58:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 04:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274184  77 58417 17906997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 04:58:27 [DEBUG   ] Got command RPT from MCS: ref #274185
2018-10-26 04:58:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 04:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274185  12 58417 17907189 A  ERRORB˜™š'
2018-10-26 04:58:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 04:58:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 04:59:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 04:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 04:59:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:59:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:59:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:59:25 [WARNING ] (13, 1, 'bot')
2018-10-26 04:59:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 04:59:25 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-26 04:59:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 04:59:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:00:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:00:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:00:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:00:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:00:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:00:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:00:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:00:25 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-10-26 05:00:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 05:00:37 [DEBUG   ] Got command RPT from MCS: ref #274190
2018-10-26 05:00:37 [DEBUG   ] summary = ERROR
2018-10-26 05:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274190  13 58417 18037277 A  ERRORERROR'
2018-10-26 05:00:37 [DEBUG   ] Got command RPT from MCS: ref #274191
2018-10-26 05:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274191  77 58417 18037278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:00:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 05:01:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 05:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:01:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:01:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:01:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:01:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:01:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:01:25 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-26 05:01:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 05:01:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 05:02:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 05:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:02:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 05:02:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:02:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:02:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:02:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:02:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:02:25 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-26 05:02:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:02:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 05:03:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:03:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:03:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:03:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:03:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:03:25 [WARNING ] (13, 1, 'bot')
2018-10-26 05:03:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:03:25 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-26 05:03:26 [DEBUG   ] Got command RPT from MCS: ref #274213
2018-10-26 05:03:26 [DEBUG   ] summary = ERROR
2018-10-26 05:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274213  13 58417 18206473 A  ERRORERROR'
2018-10-26 05:03:26 [DEBUG   ] Got command RPT from MCS: ref #274214
2018-10-26 05:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274214  77 58417 18206677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:03:26 [DEBUG   ] Got command RPT from MCS: ref #274215
2018-10-26 05:03:26 [DEBUG   ] summary = ERROR
2018-10-26 05:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274215  13 58417 18206881 A  ERRORERROR'
2018-10-26 05:03:27 [DEBUG   ] Got command RPT from MCS: ref #274217
2018-10-26 05:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274217  77 58417 18207073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:03:27 [DEBUG   ] Got command RPT from MCS: ref #274219
2018-10-26 05:03:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274219  12 58417 18207277 A  ERRORB—™š'
2018-10-26 05:03:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:03:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:04:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 05:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:04:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:04:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:04:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:04:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:04:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:04:26 [DEBUG   ] Finished updating board flags in 2.259 seconds
2018-10-26 05:04:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 05:04:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 05:05:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 05:05:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:05:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:05:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:05:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:05:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:05:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:05:26 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-10-26 05:05:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 05:05:37 [DEBUG   ] Got command RPT from MCS: ref #274227
2018-10-26 05:05:37 [DEBUG   ] summary = ERROR
2018-10-26 05:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274227  13 58417 18337289 A  ERRORERROR'
2018-10-26 05:05:37 [DEBUG   ] Got command RPT from MCS: ref #274228
2018-10-26 05:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274228  77 58417 18337290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:05:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:06:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:06:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:06:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:06:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:06:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:06:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:06:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:06:26 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-26 05:06:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 05:06:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 05:07:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 05:07:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:07:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:07:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:07:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:07:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:07:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:07:26 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-26 05:07:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 05:07:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 05:08:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:08:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:08:26 [DEBUG   ] Got command RPT from MCS: ref #274248
2018-10-26 05:08:26 [DEBUG   ] summary = ERROR
2018-10-26 05:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274248  13 58417 18506558 A  ERRORERROR'
2018-10-26 05:08:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:08:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:08:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:08:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:08:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:08:26 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-26 05:08:26 [DEBUG   ] Got command RPT from MCS: ref #274249
2018-10-26 05:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274249  77 58417 18506761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:08:26 [DEBUG   ] Got command RPT from MCS: ref #274250
2018-10-26 05:08:26 [DEBUG   ] summary = ERROR
2018-10-26 05:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274250  13 58417 18506965 A  ERRORERROR'
2018-10-26 05:08:27 [DEBUG   ] Got command RPT from MCS: ref #274251
2018-10-26 05:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274251  77 58417 18507169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:08:27 [DEBUG   ] Got command RPT from MCS: ref #274252
2018-10-26 05:08:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274252  12 58417 18507361 A  ERRORB—™š'
2018-10-26 05:08:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:08:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 05:09:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 05:09:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:09:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:09:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:09:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:09:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:09:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:09:26 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-26 05:09:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:09:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:10:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 05:10:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:10:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:10:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:10:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:10:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:10:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:10:26 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-26 05:10:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:10:37 [DEBUG   ] Got command RPT from MCS: ref #274253
2018-10-26 05:10:37 [DEBUG   ] summary = ERROR
2018-10-26 05:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274253  13 58417 18637281 A  ERRORERROR'
2018-10-26 05:10:37 [DEBUG   ] Got command RPT from MCS: ref #274254
2018-10-26 05:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274254  77 58417 18637282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:10:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:11:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 05:11:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:11:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:11:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:11:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:11:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:11:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:11:26 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-26 05:11:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 05:11:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:12:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:12:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:12:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:12:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:12:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:12:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:12:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:12:26 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-26 05:12:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 05:12:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 05:13:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 05:13:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:13:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:13:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:13:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:13:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:13:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:13:26 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-26 05:13:26 [DEBUG   ] Got command RPT from MCS: ref #274276
2018-10-26 05:13:26 [DEBUG   ] summary = ERROR
2018-10-26 05:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274276  13 58417 18806645 A  ERRORERROR'
2018-10-26 05:13:26 [DEBUG   ] Got command RPT from MCS: ref #274277
2018-10-26 05:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274277  77 58417 18806849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:13:27 [DEBUG   ] Got command RPT from MCS: ref #274278
2018-10-26 05:13:27 [DEBUG   ] summary = ERROR
2018-10-26 05:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274278  13 58417 18807053 A  ERRORERROR'
2018-10-26 05:13:27 [DEBUG   ] Got command RPT from MCS: ref #274280
2018-10-26 05:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274280  77 58417 18807245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:13:27 [DEBUG   ] Got command RPT from MCS: ref #274281
2018-10-26 05:13:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274281  12 58417 18807449 A  ERRORB—™š'
2018-10-26 05:13:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 05:13:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:14:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:14:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:14:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:14:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:14:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:14:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:14:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:14:26 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-26 05:14:31 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 05:14:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 05:15:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 05:15:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:15:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:15:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:15:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:15:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:15:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:15:26 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 05:15:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:15:37 [DEBUG   ] Got command RPT from MCS: ref #274290
2018-10-26 05:15:37 [DEBUG   ] summary = ERROR
2018-10-26 05:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274290  13 58417 18937289 A  ERRORERROR'
2018-10-26 05:15:37 [DEBUG   ] Got command RPT from MCS: ref #274291
2018-10-26 05:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274291  77 58417 18937290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:15:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:16:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:16:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 05:16:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:16:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:16:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:16:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:16:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:16:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:16:26 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-26 05:16:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:16:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:17:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:17:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 05:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-26 05:17:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:17:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:17:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:17:26 [WARNING ] (13, 1, 'bot')
2018-10-26 05:17:26 [WARNING ] (25, 5, 'bot')
2018-10-26 05:17:26 [WARNING ] (25, 5, 'bot')
2018-10-26 05:17:26 [WARNING ] (25, 5, 'bot')
2018-10-26 05:17:26 [WARNING ] (25, 5, 'bot')
2018-10-26 05:17:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:17:26 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-26 05:17:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:17:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:18:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:18:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:18:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:18:26 [DEBUG   ] Got command RPT from MCS: ref #274311
2018-10-26 05:18:26 [DEBUG   ] summary = ERROR
2018-10-26 05:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274311  13 58417 19106737 A  ERRORERROR'
2018-10-26 05:18:26 [DEBUG   ] Got command RPT from MCS: ref #274312
2018-10-26 05:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274312  77 58417 19106947 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:18:27 [DEBUG   ] Got command RPT from MCS: ref #274313
2018-10-26 05:18:27 [DEBUG   ] summary = ERROR
2018-10-26 05:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274313  13 58417 19107138 A  ERRORERROR'
2018-10-26 05:18:27 [DEBUG   ] Got command RPT from MCS: ref #274314
2018-10-26 05:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274314  77 58417 19107342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:18:27 [DEBUG   ] Got command RPT from MCS: ref #274315
2018-10-26 05:18:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274315  12 58417 19107533 A  ERRORB˜™š'
2018-10-26 05:18:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:18:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:18:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:18:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:18:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:18:27 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-10-26 05:18:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:18:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:19:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:19:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:19:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:19:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:19:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:19:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:19:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:19:27 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-26 05:19:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 05:19:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 05:20:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 05:20:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:20:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:20:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:20:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:20:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:20:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:20:27 [DEBUG   ] Finished updating board flags in 1.900 seconds
2018-10-26 05:20:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 05:20:37 [DEBUG   ] Got command RPT from MCS: ref #274320
2018-10-26 05:20:37 [DEBUG   ] summary = ERROR
2018-10-26 05:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274320  13 58417 19237285 A  ERRORERROR'
2018-10-26 05:20:37 [DEBUG   ] Got command RPT from MCS: ref #274321
2018-10-26 05:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274321  77 58417 19237286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:20:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 05:21:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:21:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:21:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:21:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:21:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:21:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:21:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:21:27 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-26 05:21:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 05:21:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:22:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:22:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:22:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:22:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:22:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:22:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:22:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:22:27 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-26 05:22:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:22:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 05:23:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:23:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:23:26 [DEBUG   ] Got command RPT from MCS: ref #274343
2018-10-26 05:23:26 [DEBUG   ] summary = ERROR
2018-10-26 05:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274343  13 58417 19406813 A  ERRORERROR'
2018-10-26 05:23:27 [DEBUG   ] Got command RPT from MCS: ref #274344
2018-10-26 05:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274344  77 58417 19407017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:23:27 [DEBUG   ] Got command RPT from MCS: ref #274345
2018-10-26 05:23:27 [DEBUG   ] summary = ERROR
2018-10-26 05:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274345  13 58417 19407221 A  ERRORERROR'
2018-10-26 05:23:27 [DEBUG   ] Got command RPT from MCS: ref #274347
2018-10-26 05:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274347  77 58417 19407429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:23:27 [DEBUG   ] Got command RPT from MCS: ref #274348
2018-10-26 05:23:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274348  12 58417 19407621 A  ERRORB˜™š'
2018-10-26 05:23:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:23:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:23:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:23:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:23:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:23:27 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-26 05:23:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:23:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:24:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 05:24:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:24:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:24:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:24:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:24:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:24:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:24:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:24:27 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-26 05:24:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:24:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:25:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 05:25:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:25:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:25:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:25:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:25:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:25:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:25:27 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-10-26 05:25:32 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2018-10-26 05:25:37 [DEBUG   ] Got command RPT from MCS: ref #274353
2018-10-26 05:25:37 [DEBUG   ] summary = ERROR
2018-10-26 05:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274353  13 58417 19537293 A  ERRORERROR'
2018-10-26 05:25:37 [DEBUG   ] Got command RPT from MCS: ref #274354
2018-10-26 05:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274354  77 58417 19537294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:25:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:26:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:26:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:26:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:26:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:26:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:26:27 [WARNING ] (13, 1, 'bot')
2018-10-26 05:26:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:26:27 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-26 05:26:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:26:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 05:27:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 05:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:27:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:27:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:27:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:27:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:27:28 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-10-26 05:27:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 05:27:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 05:28:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 05:28:26 [DEBUG   ] Got command RPT from MCS: ref #274374
2018-10-26 05:28:26 [DEBUG   ] summary = ERROR
2018-10-26 05:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274374  13 58417 19706921 A  ERRORERROR'
2018-10-26 05:28:27 [DEBUG   ] Got command RPT from MCS: ref #274375
2018-10-26 05:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274375  77 58417 19707101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:28:27 [DEBUG   ] Got command RPT from MCS: ref #274376
2018-10-26 05:28:27 [DEBUG   ] summary = ERROR
2018-10-26 05:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274376  13 58417 19707306 A  ERRORERROR'
2018-10-26 05:28:27 [DEBUG   ] Got command RPT from MCS: ref #274377
2018-10-26 05:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274377  77 58417 19707514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:28:27 [DEBUG   ] Got command RPT from MCS: ref #274378
2018-10-26 05:28:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274378  12 58417 19707705 A  ERRORBŽÌÍ'
2018-10-26 05:28:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:28:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:28:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:28:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:28:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:28:28 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 05:28:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 05:28:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:29:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 05:29:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:29:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:29:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:29:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:29:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:29:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:29:28 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-26 05:29:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:29:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:30:13 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-26 05:30:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:30:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:30:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:30:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:30:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:30:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:30:28 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-26 05:30:33 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-26 05:30:37 [DEBUG   ] Got command RPT from MCS: ref #274383
2018-10-26 05:30:37 [DEBUG   ] summary = ERROR
2018-10-26 05:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274383  13 58417 19837293 A  ERRORERROR'
2018-10-26 05:30:37 [DEBUG   ] Got command RPT from MCS: ref #274384
2018-10-26 05:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274384  77 58417 19837294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:30:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:31:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:31:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:31:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:31:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:31:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:31:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:31:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:31:28 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-26 05:31:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:31:53 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 05:32:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 05:32:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:32:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:32:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:32:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:32:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:32:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:32:28 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 05:32:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 05:32:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 05:33:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 05:33:26 [DEBUG   ] Got command RPT from MCS: ref #274406
2018-10-26 05:33:26 [DEBUG   ] summary = ERROR
2018-10-26 05:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274406  13 58417 20006993 A  ERRORERROR'
2018-10-26 05:33:27 [DEBUG   ] Got command RPT from MCS: ref #274407
2018-10-26 05:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274407  77 58417 20007198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:33:27 [DEBUG   ] Got command RPT from MCS: ref #274408
2018-10-26 05:33:27 [DEBUG   ] summary = ERROR
2018-10-26 05:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274408  13 58417 20007390 A  ERRORERROR'
2018-10-26 05:33:27 [DEBUG   ] Got command RPT from MCS: ref #274410
2018-10-26 05:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274410  77 58417 20007594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:33:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:33:27 [DEBUG   ] Got command RPT from MCS: ref #274411
2018-10-26 05:33:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274411  12 58417 20007797 A  ERRORB�ÌÍ'
2018-10-26 05:33:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:33:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:33:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:33:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:33:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:33:28 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-26 05:33:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:33:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 05:34:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:34:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:34:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:34:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:34:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:34:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:34:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:34:28 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-26 05:34:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:34:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 05:35:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 05:35:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:35:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:35:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:35:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:35:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:35:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:35:28 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-10-26 05:35:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:35:37 [DEBUG   ] Got command RPT from MCS: ref #274420
2018-10-26 05:35:37 [DEBUG   ] summary = ERROR
2018-10-26 05:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274420  13 58417 20137289 A  ERRORERROR'
2018-10-26 05:35:37 [DEBUG   ] Got command RPT from MCS: ref #274421
2018-10-26 05:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274421  77 58417 20137290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:35:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:36:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 05:36:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 05:36:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:36:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:36:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:36:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:36:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:36:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:36:28 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-26 05:36:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 05:36:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 05:37:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:37:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:37:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:37:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:37:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:37:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:37:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:37:28 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-26 05:37:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:37:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 05:38:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 05:38:27 [DEBUG   ] Got command RPT from MCS: ref #274441
2018-10-26 05:38:27 [DEBUG   ] summary = ERROR
2018-10-26 05:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274441  13 58417 20307077 A  ERRORERROR'
2018-10-26 05:38:27 [DEBUG   ] Got command RPT from MCS: ref #274442
2018-10-26 05:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274442  77 58417 20307281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:38:27 [DEBUG   ] Got command RPT from MCS: ref #274443
2018-10-26 05:38:27 [DEBUG   ] summary = ERROR
2018-10-26 05:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274443  13 58417 20307474 A  ERRORERROR'
2018-10-26 05:38:27 [DEBUG   ] Got command RPT from MCS: ref #274444
2018-10-26 05:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274444  77 58417 20307678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:38:27 [DEBUG   ] Got command RPT from MCS: ref #274445
2018-10-26 05:38:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274445  12 58417 20307881 A  ERRORB�ÌÍ'
2018-10-26 05:38:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:38:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 05:38:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:38:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:38:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:38:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:38:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:38:28 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-26 05:38:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 05:38:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:39:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:39:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:39:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:39:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:39:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:39:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:39:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:39:28 [DEBUG   ] Finished updating board flags in 1.340 seconds
2018-10-26 05:39:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:39:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:40:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 05:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:40:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:40:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:40:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:40:28 [WARNING ] (13, 1, 'bot')
2018-10-26 05:40:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:40:28 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-26 05:40:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:40:37 [DEBUG   ] Got command RPT from MCS: ref #274446
2018-10-26 05:40:37 [DEBUG   ] summary = ERROR
2018-10-26 05:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274446  13 58417 20437289 A  ERRORERROR'
2018-10-26 05:40:37 [DEBUG   ] Got command RPT from MCS: ref #274447
2018-10-26 05:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274447  77 58417 20437290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:40:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:41:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:41:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:41:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:41:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:41:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:41:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:41:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:41:29 [DEBUG   ] Finished updating board flags in 2.261 seconds
2018-10-26 05:41:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 05:41:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:42:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:42:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:42:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 05:42:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:42:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:42:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:42:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:42:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:42:29 [DEBUG   ] Finished updating board flags in 2.129 seconds
2018-10-26 05:42:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:42:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:43:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:43:27 [DEBUG   ] Got command RPT from MCS: ref #274469
2018-10-26 05:43:27 [DEBUG   ] summary = ERROR
2018-10-26 05:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274469  13 58417 20607161 A  ERRORERROR'
2018-10-26 05:43:27 [DEBUG   ] Got command RPT from MCS: ref #274470
2018-10-26 05:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274470  77 58417 20607365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:43:27 [DEBUG   ] Got command RPT from MCS: ref #274471
2018-10-26 05:43:27 [DEBUG   ] summary = ERROR
2018-10-26 05:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274471  13 58417 20607557 A  ERRORERROR'
2018-10-26 05:43:27 [DEBUG   ] Got command RPT from MCS: ref #274473
2018-10-26 05:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274473  77 58417 20607761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:43:27 [DEBUG   ] Got command RPT from MCS: ref #274474
2018-10-26 05:43:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274474  12 58417 20607965 A  ERRORB™™š'
2018-10-26 05:43:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:43:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:43:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:43:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:43:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:43:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:43:29 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-26 05:43:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:43:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:44:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:44:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:44:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 05:44:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:44:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:44:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:44:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:44:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:44:29 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-26 05:44:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:44:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:45:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:45:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:45:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:45:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:45:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:45:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:45:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:45:29 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-10-26 05:45:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:45:37 [DEBUG   ] Got command RPT from MCS: ref #274483
2018-10-26 05:45:37 [DEBUG   ] summary = ERROR
2018-10-26 05:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274483  13 58417 20737297 A  ERRORERROR'
2018-10-26 05:45:37 [DEBUG   ] Got command RPT from MCS: ref #274484
2018-10-26 05:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274484  77 58417 20737298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:45:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:46:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 05:46:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:46:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:46:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:46:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:46:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:46:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:46:29 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-26 05:46:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 05:46:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 05:47:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:47:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:47:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:47:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:47:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:47:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:47:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:47:29 [DEBUG   ] Finished updating board flags in 1.715 seconds
2018-10-26 05:47:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:47:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:48:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:48:27 [DEBUG   ] Got command RPT from MCS: ref #274504
2018-10-26 05:48:27 [DEBUG   ] summary = ERROR
2018-10-26 05:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274504  13 58417 20907241 A  ERRORERROR'
2018-10-26 05:48:27 [DEBUG   ] Got command RPT from MCS: ref #274505
2018-10-26 05:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274505  77 58417 20907445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:48:27 [DEBUG   ] Got command RPT from MCS: ref #274506
2018-10-26 05:48:27 [DEBUG   ] summary = ERROR
2018-10-26 05:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274506  13 58417 20907649 A  ERRORERROR'
2018-10-26 05:48:27 [DEBUG   ] Got command RPT from MCS: ref #274507
2018-10-26 05:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274507  77 58417 20907853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:48:28 [DEBUG   ] Got command RPT from MCS: ref #274508
2018-10-26 05:48:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274508  12 58417 20908046 A  ERRORB˜™š'
2018-10-26 05:48:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:48:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:48:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:48:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:48:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:48:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:48:29 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 05:48:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:48:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:49:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:49:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:49:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:49:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:49:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:49:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:49:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:49:29 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-26 05:49:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:49:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:50:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:50:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:50:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:50:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:50:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:50:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:50:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:50:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:50:29 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-26 05:50:35 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-26 05:50:37 [DEBUG   ] Got command RPT from MCS: ref #274513
2018-10-26 05:50:37 [DEBUG   ] summary = ERROR
2018-10-26 05:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274513  13 58417 21037297 A  ERRORERROR'
2018-10-26 05:50:37 [DEBUG   ] Got command RPT from MCS: ref #274514
2018-10-26 05:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274514  77 58417 21037298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:50:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 05:51:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 05:51:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:51:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:51:29 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-10-26 05:51:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 05:51:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 05:52:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:52:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:52:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:52:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:52:29 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 05:52:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 05:52:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 05:53:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 05:53:27 [DEBUG   ] Got command RPT from MCS: ref #274536
2018-10-26 05:53:27 [DEBUG   ] summary = ERROR
2018-10-26 05:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274536  13 58417 21207329 A  ERRORERROR'
2018-10-26 05:53:27 [DEBUG   ] Got command RPT from MCS: ref #274537
2018-10-26 05:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274537  77 58417 21207533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:53:27 [DEBUG   ] Got command RPT from MCS: ref #274538
2018-10-26 05:53:27 [DEBUG   ] summary = ERROR
2018-10-26 05:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274538  13 58417 21207737 A  ERRORERROR'
2018-10-26 05:53:27 [DEBUG   ] Got command RPT from MCS: ref #274540
2018-10-26 05:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274540  77 58417 21207932 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:53:28 [DEBUG   ] Got command RPT from MCS: ref #274541
2018-10-26 05:53:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274541  12 58417 21208133 A  ERRORB—™š'
2018-10-26 05:53:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:53:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:53:29 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-26 05:53:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:53:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 05:54:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 05:54:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:54:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:54:29 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-10-26 05:54:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 05:54:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 05:55:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 05:55:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:55:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:55:29 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-10-26 05:55:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 05:55:37 [DEBUG   ] Got command RPT from MCS: ref #274546
2018-10-26 05:55:37 [DEBUG   ] summary = ERROR
2018-10-26 05:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274546  13 58417 21337289 A  ERRORERROR'
2018-10-26 05:55:37 [DEBUG   ] Got command RPT from MCS: ref #274547
2018-10-26 05:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274547  77 58417 21337290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:55:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 05:56:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:56:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 05:56:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:56:29 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-26 05:56:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:56:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:57:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 05:57:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 05:57:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:57:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:57:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:57:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:57:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:57:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:57:30 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-10-26 05:57:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:57:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 05:58:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 05:58:27 [DEBUG   ] Got command RPT from MCS: ref #274567
2018-10-26 05:58:27 [DEBUG   ] summary = ERROR
2018-10-26 05:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274567  13 58417 21507413 A  ERRORERROR'
2018-10-26 05:58:27 [DEBUG   ] Got command RPT from MCS: ref #274568
2018-10-26 05:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274568  77 58417 21507617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:58:27 [DEBUG   ] Got command RPT from MCS: ref #274569
2018-10-26 05:58:27 [DEBUG   ] summary = ERROR
2018-10-26 05:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274569  13 58417 21507821 A  ERRORERROR'
2018-10-26 05:58:28 [DEBUG   ] Got command RPT from MCS: ref #274570
2018-10-26 05:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 05:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274570  77 58417 21508013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 05:58:28 [DEBUG   ] Got command RPT from MCS: ref #274571
2018-10-26 05:58:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 05:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274571  12 58417 21508217 A  ERRORB˜™š'
2018-10-26 05:58:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:58:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:58:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:58:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:58:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:58:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:58:30 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-10-26 05:58:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 05:58:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 05:59:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 05:59:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 05:59:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 05:59:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:59:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:59:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:59:30 [WARNING ] (13, 1, 'bot')
2018-10-26 05:59:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 05:59:30 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-26 05:59:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 05:59:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 06:00:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:00:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:00:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:00:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:00:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:00:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:00:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:00:30 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-26 06:00:37 [DEBUG   ] Got command RPT from MCS: ref #274576
2018-10-26 06:00:37 [DEBUG   ] summary = ERROR
2018-10-26 06:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274576  13 58417 21637289 A  ERRORERROR'
2018-10-26 06:00:37 [DEBUG   ] Got command RPT from MCS: ref #274577
2018-10-26 06:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274577  77 58417 21637290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:00:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:00:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:01:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:01:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 06:01:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:01:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:01:30 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-26 06:01:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:01:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:02:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:02:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:02:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:02:30 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-10-26 06:02:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:02:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:03:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:03:27 [DEBUG   ] Got command RPT from MCS: ref #274599
2018-10-26 06:03:27 [DEBUG   ] summary = ERROR
2018-10-26 06:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274599  13 58417 21807501 A  ERRORERROR'
2018-10-26 06:03:27 [DEBUG   ] Got command RPT from MCS: ref #274600
2018-10-26 06:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274600  77 58417 21807705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:03:27 [DEBUG   ] Got command RPT from MCS: ref #274601
2018-10-26 06:03:27 [DEBUG   ] summary = ERROR
2018-10-26 06:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274601  13 58417 21807897 A  ERRORERROR'
2018-10-26 06:03:28 [DEBUG   ] Got command RPT from MCS: ref #274603
2018-10-26 06:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274603  77 58417 21808101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:03:28 [DEBUG   ] Got command RPT from MCS: ref #274604
2018-10-26 06:03:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274604  12 58417 21808305 A  ERRORB™™š'
2018-10-26 06:03:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:03:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:03:30 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-26 06:03:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:03:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:04:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:04:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:04:30 [DEBUG   ] Finished updating board flags in 1.686 seconds
2018-10-26 06:04:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:04:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:05:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:05:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:05:30 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 06:05:37 [DEBUG   ] Got command RPT from MCS: ref #274613
2018-10-26 06:05:37 [DEBUG   ] summary = ERROR
2018-10-26 06:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274613  13 58417 21937293 A  ERRORERROR'
2018-10-26 06:05:37 [DEBUG   ] Got command RPT from MCS: ref #274614
2018-10-26 06:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274614  77 58417 21937294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:05:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:05:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:06:17 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 06:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:06:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:06:30 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-26 06:06:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:06:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:07:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 06:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:07:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:07:30 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-10-26 06:07:37 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 06:07:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 06:08:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:08:27 [DEBUG   ] Got command RPT from MCS: ref #274634
2018-10-26 06:08:27 [DEBUG   ] summary = ERROR
2018-10-26 06:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274634  13 58417 22107585 A  ERRORERROR'
2018-10-26 06:08:27 [DEBUG   ] Got command RPT from MCS: ref #274635
2018-10-26 06:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274635  77 58417 22107789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:08:27 [DEBUG   ] Got command RPT from MCS: ref #274636
2018-10-26 06:08:27 [DEBUG   ] summary = ERROR
2018-10-26 06:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274636  13 58417 22107993 A  ERRORERROR'
2018-10-26 06:08:28 [DEBUG   ] Got command RPT from MCS: ref #274637
2018-10-26 06:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274637  77 58417 22108185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:08:28 [DEBUG   ] Got command RPT from MCS: ref #274638
2018-10-26 06:08:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274638  12 58417 22108389 A  ERRORB˜™š'
2018-10-26 06:08:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:08:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:08:30 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-10-26 06:08:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 06:08:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:09:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:09:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 06:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:09:30 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-10-26 06:09:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:09:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 06:10:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:10:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:10:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:10:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:10:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:10:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:10:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:10:31 [DEBUG   ] Finished updating board flags in 2.139 seconds
2018-10-26 06:10:37 [DEBUG   ] Got command RPT from MCS: ref #274639
2018-10-26 06:10:37 [DEBUG   ] summary = ERROR
2018-10-26 06:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274639  13 58417 22237297 A  ERRORERROR'
2018-10-26 06:10:37 [DEBUG   ] Got command RPT from MCS: ref #274640
2018-10-26 06:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274640  77 58417 22237298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:10:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:10:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 06:11:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 06:11:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:11:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:11:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:11:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:11:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:11:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:11:31 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-26 06:11:37 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 06:11:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 06:12:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 06:12:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:12:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:12:31 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-26 06:12:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:12:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:13:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:13:27 [DEBUG   ] Got command RPT from MCS: ref #274662
2018-10-26 06:13:27 [DEBUG   ] summary = ERROR
2018-10-26 06:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274662  13 58417 22407673 A  ERRORERROR'
2018-10-26 06:13:27 [DEBUG   ] Got command RPT from MCS: ref #274663
2018-10-26 06:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274663  77 58417 22407865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:13:28 [DEBUG   ] Got command RPT from MCS: ref #274664
2018-10-26 06:13:28 [DEBUG   ] summary = ERROR
2018-10-26 06:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274664  13 58417 22408069 A  ERRORERROR'
2018-10-26 06:13:28 [DEBUG   ] Got command RPT from MCS: ref #274666
2018-10-26 06:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274666  77 58417 22408273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:13:28 [DEBUG   ] Got command RPT from MCS: ref #274667
2018-10-26 06:13:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274667  12 58417 22408477 A  ERRORB˜™š'
2018-10-26 06:13:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:13:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:13:31 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-10-26 06:13:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:13:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:14:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:14:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:14:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:14:31 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-26 06:14:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:14:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:15:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:15:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:15:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:15:31 [DEBUG   ] Finished updating board flags in 1.671 seconds
2018-10-26 06:15:37 [DEBUG   ] Got command RPT from MCS: ref #274676
2018-10-26 06:15:37 [DEBUG   ] summary = ERROR
2018-10-26 06:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274676  13 58417 22537293 A  ERRORERROR'
2018-10-26 06:15:37 [DEBUG   ] Got command RPT from MCS: ref #274677
2018-10-26 06:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274677  77 58417 22537294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:15:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 06:15:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 06:16:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:16:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:16:31 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-10-26 06:16:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:16:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:17:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:17:31 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-10-26 06:17:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 06:17:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 06:18:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:18:27 [DEBUG   ] Got command RPT from MCS: ref #274697
2018-10-26 06:18:27 [DEBUG   ] summary = ERROR
2018-10-26 06:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274697  13 58417 22707761 A  ERRORERROR'
2018-10-26 06:18:27 [DEBUG   ] Got command RPT from MCS: ref #274698
2018-10-26 06:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274698  77 58417 22707953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:18:28 [DEBUG   ] Got command RPT from MCS: ref #274699
2018-10-26 06:18:28 [DEBUG   ] summary = ERROR
2018-10-26 06:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274699  13 58417 22708157 A  ERRORERROR'
2018-10-26 06:18:28 [DEBUG   ] Got command RPT from MCS: ref #274700
2018-10-26 06:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274700  77 58417 22708361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:18:28 [DEBUG   ] Got command RPT from MCS: ref #274701
2018-10-26 06:18:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274701  12 58417 22708565 A  ERRORB˜™š'
2018-10-26 06:18:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:18:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:18:31 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-10-26 06:18:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:18:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 06:19:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 06:19:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 06:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:19:31 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-10-26 06:19:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:19:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 06:20:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 06:20:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:20:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:20:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:20:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:20:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:20:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:20:32 [DEBUG   ] Finished updating board flags in 2.291 seconds
2018-10-26 06:20:37 [DEBUG   ] Got command RPT from MCS: ref #274706
2018-10-26 06:20:37 [DEBUG   ] summary = ERROR
2018-10-26 06:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274706  13 58417 22837293 A  ERRORERROR'
2018-10-26 06:20:37 [DEBUG   ] Got command RPT from MCS: ref #274707
2018-10-26 06:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274707  77 58417 22837294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:20:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:20:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:21:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 06:21:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:21:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 06:21:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:21:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:21:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:21:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:21:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:21:32 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-10-26 06:21:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 06:21:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:22:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:22:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:22:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:22:32 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-10-26 06:22:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 06:22:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 06:23:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 06:23:27 [DEBUG   ] Got command RPT from MCS: ref #274729
2018-10-26 06:23:27 [DEBUG   ] summary = ERROR
2018-10-26 06:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274729  13 58417 23007845 A  ERRORERROR'
2018-10-26 06:23:28 [DEBUG   ] Got command RPT from MCS: ref #274730
2018-10-26 06:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274730  77 58417 23008049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:23:28 [DEBUG   ] Got command RPT from MCS: ref #274731
2018-10-26 06:23:28 [DEBUG   ] summary = ERROR
2018-10-26 06:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274731  13 58417 23008241 A  ERRORERROR'
2018-10-26 06:23:28 [DEBUG   ] Got command RPT from MCS: ref #274733
2018-10-26 06:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274733  77 58417 23008445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:23:28 [DEBUG   ] Got command RPT from MCS: ref #274734
2018-10-26 06:23:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274734  12 58417 23008649 A  ERRORB˜™š'
2018-10-26 06:23:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:23:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:23:32 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-10-26 06:23:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 06:23:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 06:24:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 06:24:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:24:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:24:32 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-26 06:24:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:24:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:25:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:25:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:25:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:25:32 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-26 06:25:37 [DEBUG   ] Got command RPT from MCS: ref #274739
2018-10-26 06:25:37 [DEBUG   ] summary = ERROR
2018-10-26 06:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274739  13 58417 23137305 A  ERRORERROR'
2018-10-26 06:25:37 [DEBUG   ] Got command RPT from MCS: ref #274740
2018-10-26 06:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274740  77 58417 23137306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:25:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:25:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:26:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:26:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:26:32 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 06:26:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:26:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:27:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:27:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:27:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:27:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:27:32 [DEBUG   ] Finished updating board flags in 1.700 seconds
2018-10-26 06:27:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:27:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:28:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:28:27 [DEBUG   ] Got command RPT from MCS: ref #274760
2018-10-26 06:28:27 [DEBUG   ] summary = ERROR
2018-10-26 06:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274760  13 58417 23307933 A  ERRORERROR'
2018-10-26 06:28:28 [DEBUG   ] Got command RPT from MCS: ref #274761
2018-10-26 06:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274761  77 58417 23308137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:28:28 [DEBUG   ] Got command RPT from MCS: ref #274762
2018-10-26 06:28:28 [DEBUG   ] summary = ERROR
2018-10-26 06:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274762  13 58417 23308329 A  ERRORERROR'
2018-10-26 06:28:28 [DEBUG   ] Got command RPT from MCS: ref #274763
2018-10-26 06:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274763  77 58417 23308533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:28:28 [DEBUG   ] Got command RPT from MCS: ref #274764
2018-10-26 06:28:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274764  12 58417 23308737 A  ERRORB˜™š'
2018-10-26 06:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:28:32 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-26 06:28:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:28:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:29:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:29:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 06:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:29:32 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-26 06:29:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:29:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:30:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:30:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:30:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:30:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:30:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:30:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:30:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:30:33 [DEBUG   ] Finished updating board flags in 2.251 seconds
2018-10-26 06:30:37 [DEBUG   ] Got command RPT from MCS: ref #274769
2018-10-26 06:30:37 [DEBUG   ] summary = ERROR
2018-10-26 06:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274769  13 58417 23437305 A  ERRORERROR'
2018-10-26 06:30:37 [DEBUG   ] Got command RPT from MCS: ref #274770
2018-10-26 06:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274770  77 58417 23437306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:30:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:30:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:31:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:31:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:31:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:31:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:31:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:31:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:31:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:31:33 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-26 06:31:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:31:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 06:32:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:32:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:32:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:32:33 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-26 06:32:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:32:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:33:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #274792
2018-10-26 06:33:28 [DEBUG   ] summary = ERROR
2018-10-26 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274792  13 58417 23608017 A  ERRORERROR'
2018-10-26 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #274793
2018-10-26 06:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274793  77 58417 23608221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #274794
2018-10-26 06:33:28 [DEBUG   ] summary = ERROR
2018-10-26 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274794  13 58417 23608413 A  ERRORERROR'
2018-10-26 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #274796
2018-10-26 06:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274796  77 58417 23608617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #274798
2018-10-26 06:33:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274798  12 58417 23608821 A  ERRORB—™š'
2018-10-26 06:33:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:33:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:33:33 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-10-26 06:33:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:33:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:34:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 06:34:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:34:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:34:33 [DEBUG   ] Finished updating board flags in 1.962 seconds
2018-10-26 06:34:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:34:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:35:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:35:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:35:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:35:33 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 06:35:37 [DEBUG   ] Got command RPT from MCS: ref #274806
2018-10-26 06:35:37 [DEBUG   ] summary = ERROR
2018-10-26 06:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274806  13 58417 23737301 A  ERRORERROR'
2018-10-26 06:35:37 [DEBUG   ] Got command RPT from MCS: ref #274807
2018-10-26 06:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274807  77 58417 23737302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:35:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:35:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:36:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:36:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:36:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:36:33 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-26 06:36:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:36:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:37:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:37:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:37:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:37:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:37:33 [DEBUG   ] Finished updating board flags in 1.865 seconds
2018-10-26 06:37:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:37:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:38:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #274827
2018-10-26 06:38:28 [DEBUG   ] summary = ERROR
2018-10-26 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274827  13 58417 23908101 A  ERRORERROR'
2018-10-26 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #274828
2018-10-26 06:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274828  77 58417 23908305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #274829
2018-10-26 06:38:28 [DEBUG   ] summary = ERROR
2018-10-26 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274829  13 58417 23908509 A  ERRORERROR'
2018-10-26 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #274830
2018-10-26 06:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274830  77 58417 23908701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #274831
2018-10-26 06:38:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274831  12 58417 23908905 A  ERRORB™™š'
2018-10-26 06:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:38:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:38:33 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-10-26 06:38:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:38:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:39:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:39:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:39:33 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-10-26 06:39:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:39:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:40:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:40:33 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-26 06:40:37 [DEBUG   ] Got command RPT from MCS: ref #274832
2018-10-26 06:40:37 [DEBUG   ] summary = ERROR
2018-10-26 06:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274832  13 58417 24037309 A  ERRORERROR'
2018-10-26 06:40:37 [DEBUG   ] Got command RPT from MCS: ref #274833
2018-10-26 06:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274833  77 58417 24037310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:40:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:40:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:41:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 06:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:41:33 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-26 06:41:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:41:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 06:42:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:42:33 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-26 06:42:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 06:42:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 06:43:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #274855
2018-10-26 06:43:28 [DEBUG   ] summary = ERROR
2018-10-26 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274855  13 58417 24208189 A  ERRORERROR'
2018-10-26 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #274856
2018-10-26 06:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274856  77 58417 24208393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #274857
2018-10-26 06:43:28 [DEBUG   ] summary = ERROR
2018-10-26 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274857  13 58417 24208585 A  ERRORERROR'
2018-10-26 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #274859
2018-10-26 06:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274859  77 58417 24208789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #274860
2018-10-26 06:43:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274860  12 58417 24208993 A  ERRORB™™š'
2018-10-26 06:43:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:43:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:43:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:43:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:43:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:43:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:43:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:43:33 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-10-26 06:43:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 06:44:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 06:44:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 06:44:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:44:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:44:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:44:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:44:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:44:33 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-10-26 06:44:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:45:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:45:20 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 06:45:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:45:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:45:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:45:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:45:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:45:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:45:33 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-26 06:45:37 [DEBUG   ] Got command RPT from MCS: ref #274869
2018-10-26 06:45:37 [DEBUG   ] summary = ERROR
2018-10-26 06:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274869  13 58417 24337301 A  ERRORERROR'
2018-10-26 06:45:37 [DEBUG   ] Got command RPT from MCS: ref #274870
2018-10-26 06:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274870  77 58417 24337302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:45:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:46:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 06:46:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:46:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:46:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:46:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:46:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:46:33 [WARNING ] (13, 1, 'bot')
2018-10-26 06:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:46:33 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-26 06:46:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 06:47:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 06:47:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 06:47:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:47:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:47:34 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-10-26 06:47:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 06:48:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 06:48:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 06:48:28 [DEBUG   ] Got command RPT from MCS: ref #274890
2018-10-26 06:48:28 [DEBUG   ] summary = ERROR
2018-10-26 06:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274890  13 58417 24508273 A  ERRORERROR'
2018-10-26 06:48:28 [DEBUG   ] Got command RPT from MCS: ref #274891
2018-10-26 06:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274891  77 58417 24508477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:48:28 [DEBUG   ] Got command RPT from MCS: ref #274892
2018-10-26 06:48:28 [DEBUG   ] summary = ERROR
2018-10-26 06:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274892  13 58417 24508669 A  ERRORERROR'
2018-10-26 06:48:28 [DEBUG   ] Got command RPT from MCS: ref #274893
2018-10-26 06:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274893  77 58417 24508873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:48:29 [DEBUG   ] Got command RPT from MCS: ref #274894
2018-10-26 06:48:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274894  12 58417 24509077 A  ERRORB˜™š'
2018-10-26 06:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:48:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:48:34 [DEBUG   ] Finished updating board flags in 2.139 seconds
2018-10-26 06:48:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:49:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 06:49:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 06:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:49:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:49:34 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-10-26 06:49:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 06:50:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 06:50:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 06:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 06:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 06:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:50:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:50:34 [DEBUG   ] Finished updating board flags in 1.871 seconds
2018-10-26 06:50:37 [DEBUG   ] Got command RPT from MCS: ref #274899
2018-10-26 06:50:37 [DEBUG   ] summary = ERROR
2018-10-26 06:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274899  13 58417 24637301 A  ERRORERROR'
2018-10-26 06:50:37 [DEBUG   ] Got command RPT from MCS: ref #274900
2018-10-26 06:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274900  77 58417 24637302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:50:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:51:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:51:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 06:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 06:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:51:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:51:34 [DEBUG   ] Finished updating board flags in 1.703 seconds
2018-10-26 06:51:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:52:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:52:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:52:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 06:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:52:34 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-26 06:52:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 06:53:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 06:53:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:53:28 [DEBUG   ] Got command RPT from MCS: ref #274922
2018-10-26 06:53:28 [DEBUG   ] summary = ERROR
2018-10-26 06:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274922  13 58417 24808361 A  ERRORERROR'
2018-10-26 06:53:28 [DEBUG   ] Got command RPT from MCS: ref #274923
2018-10-26 06:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274923  77 58417 24808565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:53:28 [DEBUG   ] Got command RPT from MCS: ref #274924
2018-10-26 06:53:28 [DEBUG   ] summary = ERROR
2018-10-26 06:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274924  13 58417 24808757 A  ERRORERROR'
2018-10-26 06:53:28 [DEBUG   ] Got command RPT from MCS: ref #274926
2018-10-26 06:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274926  77 58417 24808961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:53:29 [DEBUG   ] Got command RPT from MCS: ref #274927
2018-10-26 06:53:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274927  12 58417 24809165 A  ERRORB˜™š'
2018-10-26 06:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:53:34 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-26 06:53:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 06:54:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 06:54:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:54:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:54:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:54:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:54:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:54:34 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-26 06:54:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:55:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 06:55:20 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-26 06:55:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:55:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:55:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:55:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:55:34 [WARNING ] (13, 1, 'bot')
2018-10-26 06:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:55:34 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-26 06:55:37 [DEBUG   ] Got command RPT from MCS: ref #274932
2018-10-26 06:55:37 [DEBUG   ] summary = ERROR
2018-10-26 06:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274932  13 58417 24937305 A  ERRORERROR'
2018-10-26 06:55:37 [DEBUG   ] Got command RPT from MCS: ref #274933
2018-10-26 06:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274933  77 58417 24937306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:55:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 06:56:00 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 06:56:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 06:56:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:56:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:56:35 [DEBUG   ] Finished updating board flags in 2.243 seconds
2018-10-26 06:56:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 06:57:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:57:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:57:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:57:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:57:35 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-10-26 06:57:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 06:58:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:58:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 06:58:28 [DEBUG   ] Got command RPT from MCS: ref #274953
2018-10-26 06:58:28 [DEBUG   ] summary = ERROR
2018-10-26 06:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274953  13 58417 25108445 A  ERRORERROR'
2018-10-26 06:58:28 [DEBUG   ] Got command RPT from MCS: ref #274954
2018-10-26 06:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274954  77 58417 25108637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:58:28 [DEBUG   ] Got command RPT from MCS: ref #274955
2018-10-26 06:58:28 [DEBUG   ] summary = ERROR
2018-10-26 06:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274955  13 58417 25108841 A  ERRORERROR'
2018-10-26 06:58:29 [DEBUG   ] Got command RPT from MCS: ref #274956
2018-10-26 06:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 06:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274956  77 58417 25109045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 06:58:29 [DEBUG   ] Got command RPT from MCS: ref #274957
2018-10-26 06:58:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 06:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274957  12 58417 25109249 A  ERRORB™™š'
2018-10-26 06:58:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:58:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:58:35 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-10-26 06:58:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 06:59:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 06:59:21 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 06:59:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 06:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 06:59:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 06:59:35 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-10-26 06:59:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 07:00:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 07:00:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 07:00:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:00:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 07:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:00:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:00:35 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-26 07:00:37 [DEBUG   ] Got command RPT from MCS: ref #274962
2018-10-26 07:00:37 [DEBUG   ] summary = ERROR
2018-10-26 07:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274962  13 58417 25237309 A  ERRORERROR'
2018-10-26 07:00:37 [DEBUG   ] Got command RPT from MCS: ref #274963
2018-10-26 07:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274963  77 58417 25237310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:00:42 [DEBUG   ] Finished updating ant stats in 2.001 seconds
2018-10-26 07:01:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 07:01:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 07:01:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:01:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:01:35 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-26 07:01:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 07:02:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 07:02:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 07:02:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:02:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:02:35 [DEBUG   ] Finished updating board flags in 1.672 seconds
2018-10-26 07:02:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 07:03:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 07:03:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 07:03:28 [DEBUG   ] Got command RPT from MCS: ref #274985
2018-10-26 07:03:28 [DEBUG   ] summary = ERROR
2018-10-26 07:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274985  13 58417 25408525 A  ERRORERROR'
2018-10-26 07:03:28 [DEBUG   ] Got command RPT from MCS: ref #274986
2018-10-26 07:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274986  77 58417 25408729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:03:28 [DEBUG   ] Got command RPT from MCS: ref #274987
2018-10-26 07:03:28 [DEBUG   ] summary = ERROR
2018-10-26 07:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274987  13 58417 25408933 A  ERRORERROR'
2018-10-26 07:03:29 [DEBUG   ] Got command RPT from MCS: ref #274989
2018-10-26 07:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274989  77 58417 25409125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:03:29 [DEBUG   ] Got command RPT from MCS: ref #274991
2018-10-26 07:03:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274991  12 58417 25409329 A  ERRORB˜™š'
2018-10-26 07:03:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:03:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:03:35 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-10-26 07:03:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:04:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 07:04:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 07:04:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 07:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:04:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:04:35 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-26 07:04:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:05:01 [DEBUG   ] Finished updating ant stats in 1.036 seconds
2018-10-26 07:05:21 [DEBUG   ] Finished updating ant stats in 0.567 seconds
2018-10-26 07:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:05:35 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-10-26 07:05:37 [DEBUG   ] Got command RPT from MCS: ref #274999
2018-10-26 07:05:37 [DEBUG   ] summary = ERROR
2018-10-26 07:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   274999  13 58417 25537313 A  ERRORERROR'
2018-10-26 07:05:37 [DEBUG   ] Got command RPT from MCS: ref #275000
2018-10-26 07:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275000  77 58417 25537314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:05:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 07:06:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 07:06:22 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 07:06:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:06:35 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-10-26 07:06:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 07:07:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:07:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:07:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:07:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 07:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:07:35 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-26 07:07:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:08:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:08:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 07:08:28 [DEBUG   ] Got command RPT from MCS: ref #275020
2018-10-26 07:08:28 [DEBUG   ] summary = ERROR
2018-10-26 07:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275020  13 58417 25708609 A  ERRORERROR'
2018-10-26 07:08:28 [DEBUG   ] Got command RPT from MCS: ref #275021
2018-10-26 07:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275021  77 58417 25708813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:08:29 [DEBUG   ] Got command RPT from MCS: ref #275022
2018-10-26 07:08:29 [DEBUG   ] summary = ERROR
2018-10-26 07:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275022  13 58417 25709017 A  ERRORERROR'
2018-10-26 07:08:29 [DEBUG   ] Got command RPT from MCS: ref #275023
2018-10-26 07:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275023  77 58417 25709221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:08:29 [DEBUG   ] Got command RPT from MCS: ref #275024
2018-10-26 07:08:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275024  12 58417 25709413 A  ERRORB˜™š'
2018-10-26 07:08:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 07:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:08:35 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-10-26 07:08:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:09:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 07:09:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 07:09:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:09:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:09:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:09:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:09:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:09:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:09:36 [DEBUG   ] Finished updating board flags in 2.193 seconds
2018-10-26 07:09:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 07:10:02 [DEBUG   ] Finished updating ant stats in 1.375 seconds
2018-10-26 07:10:22 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-10-26 07:10:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:10:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:10:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:10:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:10:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:10:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:10:36 [DEBUG   ] Finished updating board flags in 1.924 seconds
2018-10-26 07:10:37 [DEBUG   ] Got command RPT from MCS: ref #275025
2018-10-26 07:10:37 [DEBUG   ] summary = ERROR
2018-10-26 07:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275025  13 58417 25837309 A  ERRORERROR'
2018-10-26 07:10:37 [DEBUG   ] Got command RPT from MCS: ref #275026
2018-10-26 07:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275026  77 58417 25837310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:10:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:11:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:11:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:11:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:11:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:11:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:11:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:11:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:11:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:11:36 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-26 07:11:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:12:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:12:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:12:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:12:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:12:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:12:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:12:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:12:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:12:36 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-26 07:12:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:13:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:13:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:13:28 [DEBUG   ] Got command RPT from MCS: ref #275048
2018-10-26 07:13:28 [DEBUG   ] summary = ERROR
2018-10-26 07:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275048  13 58417 26008701 A  ERRORERROR'
2018-10-26 07:13:28 [DEBUG   ] Got command RPT from MCS: ref #275049
2018-10-26 07:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275049  77 58417 26008893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:13:29 [DEBUG   ] Got command RPT from MCS: ref #275050
2018-10-26 07:13:29 [DEBUG   ] summary = ERROR
2018-10-26 07:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275050  13 58417 26009097 A  ERRORERROR'
2018-10-26 07:13:29 [DEBUG   ] Got command RPT from MCS: ref #275052
2018-10-26 07:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275052  77 58417 26009301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:13:29 [DEBUG   ] Got command RPT from MCS: ref #275053
2018-10-26 07:13:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275053  12 58417 26009505 A  ERRORB™™š'
2018-10-26 07:13:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:13:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:13:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:13:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:13:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:13:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:13:36 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-26 07:13:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:14:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:14:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:14:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:14:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:14:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:14:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:14:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:14:36 [DEBUG   ] Finished updating board flags in 1.706 seconds
2018-10-26 07:14:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:15:02 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-10-26 07:15:22 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-10-26 07:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:15:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:15:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:15:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:15:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:15:36 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-10-26 07:15:37 [DEBUG   ] Got command RPT from MCS: ref #275062
2018-10-26 07:15:37 [DEBUG   ] summary = ERROR
2018-10-26 07:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275062  13 58417 26137309 A  ERRORERROR'
2018-10-26 07:15:37 [DEBUG   ] Got command RPT from MCS: ref #275063
2018-10-26 07:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275063  77 58417 26137310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:15:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:16:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:16:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:16:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:16:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:16:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:16:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:16:36 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-10-26 07:16:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:17:03 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2018-10-26 07:17:22 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-26 07:17:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:17:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:17:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:17:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:17:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:17:36 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-10-26 07:17:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-26 07:18:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 07:18:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 07:18:28 [DEBUG   ] Got command RPT from MCS: ref #275083
2018-10-26 07:18:28 [DEBUG   ] summary = ERROR
2018-10-26 07:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275083  13 58417 26308789 A  ERRORERROR'
2018-10-26 07:18:28 [DEBUG   ] Got command RPT from MCS: ref #275084
2018-10-26 07:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275084  77 58417 26308993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:18:29 [DEBUG   ] Got command RPT from MCS: ref #275085
2018-10-26 07:18:29 [DEBUG   ] summary = ERROR
2018-10-26 07:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275085  13 58417 26309186 A  ERRORERROR'
2018-10-26 07:18:29 [DEBUG   ] Got command RPT from MCS: ref #275086
2018-10-26 07:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275086  77 58417 26309389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:18:29 [DEBUG   ] Got command RPT from MCS: ref #275087
2018-10-26 07:18:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275087  12 58417 26309593 A  ERRORB˜™š'
2018-10-26 07:18:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:18:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:18:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:18:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:18:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:18:36 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-10-26 07:18:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:19:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:19:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:19:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:19:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:19:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:19:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:19:36 [WARNING ] (13, 1, 'bot')
2018-10-26 07:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:19:36 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-10-26 07:19:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:20:03 [DEBUG   ] Finished updating ant stats in 1.559 seconds
2018-10-26 07:20:23 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-26 07:20:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:20:37 [DEBUG   ] Got command RPT from MCS: ref #275092
2018-10-26 07:20:37 [DEBUG   ] summary = ERROR
2018-10-26 07:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275092  13 58417 26437317 A  ERRORERROR'
2018-10-26 07:20:37 [DEBUG   ] Got command RPT from MCS: ref #275093
2018-10-26 07:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275093  77 58417 26437318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:20:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:20:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:20:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:20:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:20:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:20:37 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-10-26 07:20:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 07:21:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 07:21:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 07:21:36 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 07:21:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:21:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:21:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:21:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:21:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:21:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:21:37 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-26 07:21:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 07:22:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:22:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 07:22:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:22:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:22:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:22:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:22:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:22:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:22:37 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 07:22:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:23:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:23:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:23:28 [DEBUG   ] Got command RPT from MCS: ref #275115
2018-10-26 07:23:28 [DEBUG   ] summary = ERROR
2018-10-26 07:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275115  13 58417 26608877 A  ERRORERROR'
2018-10-26 07:23:29 [DEBUG   ] Got command RPT from MCS: ref #275116
2018-10-26 07:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275116  77 58417 26609069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:23:29 [DEBUG   ] Got command RPT from MCS: ref #275117
2018-10-26 07:23:29 [DEBUG   ] summary = ERROR
2018-10-26 07:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275117  13 58417 26609273 A  ERRORERROR'
2018-10-26 07:23:29 [DEBUG   ] Got command RPT from MCS: ref #275119
2018-10-26 07:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275119  77 58417 26609477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:23:29 [DEBUG   ] Got command RPT from MCS: ref #275121
2018-10-26 07:23:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275121  12 58417 26609681 A  ERRORB˜™š'
2018-10-26 07:23:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:23:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:23:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:23:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:23:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:23:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:23:37 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-26 07:23:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:24:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:24:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:24:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:24:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:24:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:24:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:24:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:24:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:24:37 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-10-26 07:24:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:25:03 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-10-26 07:25:23 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-10-26 07:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:25:37 [DEBUG   ] Got command RPT from MCS: ref #275125
2018-10-26 07:25:37 [DEBUG   ] summary = ERROR
2018-10-26 07:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275125  13 58417 26737309 A  ERRORERROR'
2018-10-26 07:25:37 [DEBUG   ] Got command RPT from MCS: ref #275126
2018-10-26 07:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275126  77 58417 26737310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:25:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:25:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:25:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:25:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:25:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:25:37 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-26 07:25:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:26:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:26:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 07:26:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:26:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:26:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:26:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:26:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:26:37 [DEBUG   ] Finished updating board flags in 1.559 seconds
2018-10-26 07:26:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:27:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:27:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:27:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:27:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:27:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:27:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:27:37 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-10-26 07:27:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:28:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:28:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:28:28 [DEBUG   ] Got command RPT from MCS: ref #275146
2018-10-26 07:28:28 [DEBUG   ] summary = ERROR
2018-10-26 07:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275146  13 58417 26908953 A  ERRORERROR'
2018-10-26 07:28:29 [DEBUG   ] Got command RPT from MCS: ref #275147
2018-10-26 07:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275147  77 58417 26909157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:28:29 [DEBUG   ] Got command RPT from MCS: ref #275148
2018-10-26 07:28:29 [DEBUG   ] summary = ERROR
2018-10-26 07:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275148  13 58417 26909361 A  ERRORERROR'
2018-10-26 07:28:29 [DEBUG   ] Got command RPT from MCS: ref #275149
2018-10-26 07:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275149  77 58417 26909565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:28:29 [DEBUG   ] Got command RPT from MCS: ref #275150
2018-10-26 07:28:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275150  12 58417 26909757 A  ERRORB™™š'
2018-10-26 07:28:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 07:28:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:28:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:28:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:28:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:28:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:28:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:28:37 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-26 07:28:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:29:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:29:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:29:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:29:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:29:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:29:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:29:37 [WARNING ] (13, 1, 'bot')
2018-10-26 07:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:29:37 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-10-26 07:29:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:30:03 [DEBUG   ] Finished updating ant stats in 0.962 seconds
2018-10-26 07:30:23 [DEBUG   ] Finished updating ant stats in 0.442 seconds
2018-10-26 07:30:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 07:30:37 [DEBUG   ] Got command RPT from MCS: ref #275155
2018-10-26 07:30:37 [DEBUG   ] summary = ERROR
2018-10-26 07:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275155  13 58417 27037318 A  ERRORERROR'
2018-10-26 07:30:37 [DEBUG   ] Got command RPT from MCS: ref #275156
2018-10-26 07:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275156  77 58417 27037318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:30:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:30:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:30:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:30:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:30:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:30:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:30:38 [DEBUG   ] Finished updating board flags in 2.163 seconds
2018-10-26 07:30:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 07:31:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 07:31:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 07:31:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:31:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:31:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:31:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:31:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:31:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:31:38 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-10-26 07:31:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 07:32:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:32:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:32:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:32:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:32:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:32:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:32:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:32:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:32:38 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-26 07:32:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:33:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:33:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:33:29 [DEBUG   ] Got command RPT from MCS: ref #275178
2018-10-26 07:33:29 [DEBUG   ] summary = ERROR
2018-10-26 07:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275178  13 58417 27209041 A  ERRORERROR'
2018-10-26 07:33:29 [DEBUG   ] Got command RPT from MCS: ref #275179
2018-10-26 07:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275179  77 58417 27209245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:33:29 [DEBUG   ] Got command RPT from MCS: ref #275180
2018-10-26 07:33:29 [DEBUG   ] summary = ERROR
2018-10-26 07:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275180  13 58417 27209449 A  ERRORERROR'
2018-10-26 07:33:29 [DEBUG   ] Got command RPT from MCS: ref #275182
2018-10-26 07:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275182  77 58417 27209641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:33:29 [DEBUG   ] Got command RPT from MCS: ref #275183
2018-10-26 07:33:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275183  12 58417 27209845 A  ERRORB˜™š'
2018-10-26 07:33:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:33:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:33:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:33:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:33:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:33:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:33:38 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-10-26 07:33:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:34:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:34:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:34:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:34:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:34:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:34:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:34:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:34:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:34:38 [DEBUG   ] Finished updating board flags in 1.755 seconds
2018-10-26 07:34:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:35:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 07:35:24 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-26 07:35:37 [DEBUG   ] Got command RPT from MCS: ref #275192
2018-10-26 07:35:37 [DEBUG   ] summary = ERROR
2018-10-26 07:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275192  13 58417 27337314 A  ERRORERROR'
2018-10-26 07:35:37 [DEBUG   ] Got command RPT from MCS: ref #275193
2018-10-26 07:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275193  77 58417 27337314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:35:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:35:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:35:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:35:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:35:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:35:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:35:38 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-26 07:35:44 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 07:36:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:36:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:36:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:36:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:36:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:36:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:36:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:36:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:36:38 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-26 07:36:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:37:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:37:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:37:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:37:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:37:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:37:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:37:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:37:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:37:38 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-10-26 07:37:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:38:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:38:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:38:29 [DEBUG   ] Got command RPT from MCS: ref #275213
2018-10-26 07:38:29 [DEBUG   ] summary = ERROR
2018-10-26 07:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275213  13 58417 27509133 A  ERRORERROR'
2018-10-26 07:38:29 [DEBUG   ] Got command RPT from MCS: ref #275214
2018-10-26 07:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275214  77 58417 27509337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:38:29 [DEBUG   ] Got command RPT from MCS: ref #275215
2018-10-26 07:38:29 [DEBUG   ] summary = ERROR
2018-10-26 07:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275215  13 58417 27509529 A  ERRORERROR'
2018-10-26 07:38:29 [DEBUG   ] Got command RPT from MCS: ref #275216
2018-10-26 07:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275216  77 58417 27509733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:38:29 [DEBUG   ] Got command RPT from MCS: ref #275217
2018-10-26 07:38:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275217  12 58417 27509937 A  ERRORB˜™š'
2018-10-26 07:38:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 07:38:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:38:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:38:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:38:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:38:38 [WARNING ] (13, 1, 'bot')
2018-10-26 07:38:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:38:38 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-10-26 07:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:39:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:39:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:39:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:39:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:39:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:39:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:39:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:39:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:39:39 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-10-26 07:39:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:40:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:40:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:40:37 [DEBUG   ] Got command RPT from MCS: ref #275218
2018-10-26 07:40:37 [DEBUG   ] summary = ERROR
2018-10-26 07:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275218  13 58417 27637321 A  ERRORERROR'
2018-10-26 07:40:37 [DEBUG   ] Got command RPT from MCS: ref #275219
2018-10-26 07:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275219  77 58417 27637322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:40:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:40:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:40:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:40:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:40:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:40:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:40:39 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-10-26 07:40:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:41:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:41:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:41:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:41:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:41:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:41:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:41:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:41:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:41:39 [DEBUG   ] Finished updating board flags in 2.088 seconds
2018-10-26 07:41:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:42:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:42:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 07:42:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:42:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:42:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:42:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:42:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:42:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:42:39 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-10-26 07:42:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:43:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:43:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:43:29 [DEBUG   ] Got command RPT from MCS: ref #275241
2018-10-26 07:43:29 [DEBUG   ] summary = ERROR
2018-10-26 07:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275241  13 58417 27809217 A  ERRORERROR'
2018-10-26 07:43:29 [DEBUG   ] Got command RPT from MCS: ref #275242
2018-10-26 07:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275242  77 58417 27809421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:43:29 [DEBUG   ] Got command RPT from MCS: ref #275243
2018-10-26 07:43:29 [DEBUG   ] summary = ERROR
2018-10-26 07:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275243  13 58417 27809613 A  ERRORERROR'
2018-10-26 07:43:29 [DEBUG   ] Got command RPT from MCS: ref #275245
2018-10-26 07:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275245  77 58417 27809817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:43:30 [DEBUG   ] Got command RPT from MCS: ref #275247
2018-10-26 07:43:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275247  12 58417 27810021 A  ERRORB™™š'
2018-10-26 07:43:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:43:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:43:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:43:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:43:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:43:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:43:39 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-26 07:43:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:44:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:44:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:44:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:44:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:44:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:44:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:44:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:44:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:44:39 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-26 07:44:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 07:45:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:45:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:45:37 [DEBUG   ] Got command RPT from MCS: ref #275255
2018-10-26 07:45:37 [DEBUG   ] summary = ERROR
2018-10-26 07:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275255  13 58417 27937321 A  ERRORERROR'
2018-10-26 07:45:37 [DEBUG   ] Got command RPT from MCS: ref #275256
2018-10-26 07:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275256  77 58417 27937322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:45:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 07:45:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:45:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:45:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:45:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:45:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:45:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:45:39 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 07:45:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:46:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:46:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:46:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:46:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:46:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:46:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:46:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:46:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:46:39 [DEBUG   ] Finished updating board flags in 1.658 seconds
2018-10-26 07:46:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:47:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 07:47:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 07:47:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:47:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:47:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:47:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:47:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:47:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:47:39 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-10-26 07:47:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 07:48:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:48:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 07:48:29 [DEBUG   ] Got command RPT from MCS: ref #275276
2018-10-26 07:48:29 [DEBUG   ] summary = ERROR
2018-10-26 07:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275276  13 58417 28109301 A  ERRORERROR'
2018-10-26 07:48:29 [DEBUG   ] Got command RPT from MCS: ref #275277
2018-10-26 07:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275277  77 58417 28109505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:48:29 [DEBUG   ] Got command RPT from MCS: ref #275278
2018-10-26 07:48:29 [DEBUG   ] summary = ERROR
2018-10-26 07:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275278  13 58417 28109709 A  ERRORERROR'
2018-10-26 07:48:29 [DEBUG   ] Got command RPT from MCS: ref #275279
2018-10-26 07:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275279  77 58417 28109901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:48:30 [DEBUG   ] Got command RPT from MCS: ref #275280
2018-10-26 07:48:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275280  12 58417 28110105 A  ERRORB˜™š'
2018-10-26 07:48:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:48:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:48:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:48:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:48:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:48:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:48:39 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-26 07:48:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 07:49:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 07:49:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 07:49:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:49:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 07:49:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:49:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:49:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:49:39 [WARNING ] (13, 1, 'bot')
2018-10-26 07:49:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:49:39 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-26 07:49:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 07:50:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:50:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:50:37 [DEBUG   ] Got command RPT from MCS: ref #275285
2018-10-26 07:50:37 [DEBUG   ] summary = ERROR
2018-10-26 07:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275285  13 58417 28237317 A  ERRORERROR'
2018-10-26 07:50:37 [DEBUG   ] Got command RPT from MCS: ref #275286
2018-10-26 07:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275286  77 58417 28237318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:50:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:50:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:50:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:50:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:50:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:50:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:50:40 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-10-26 07:50:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:51:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:51:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 07:51:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:51:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:51:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:51:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:51:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:51:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:51:40 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-10-26 07:51:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 07:52:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 07:52:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 07:52:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:52:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 07:52:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:52:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:52:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:52:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:52:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:52:40 [DEBUG   ] Finished updating board flags in 2.166 seconds
2018-10-26 07:52:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:53:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 07:53:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:53:29 [DEBUG   ] Got command RPT from MCS: ref #275308
2018-10-26 07:53:29 [DEBUG   ] summary = ERROR
2018-10-26 07:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275308  13 58417 28409389 A  ERRORERROR'
2018-10-26 07:53:29 [DEBUG   ] Got command RPT from MCS: ref #275309
2018-10-26 07:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275309  77 58417 28409593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:53:29 [DEBUG   ] Got command RPT from MCS: ref #275310
2018-10-26 07:53:29 [DEBUG   ] summary = ERROR
2018-10-26 07:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275310  13 58417 28409785 A  ERRORERROR'
2018-10-26 07:53:29 [DEBUG   ] Got command RPT from MCS: ref #275312
2018-10-26 07:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275312  77 58417 28409989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:53:30 [DEBUG   ] Got command RPT from MCS: ref #275313
2018-10-26 07:53:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275313  12 58417 28410193 A  ERRORB™™š'
2018-10-26 07:53:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:53:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:53:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:53:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:53:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:53:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:53:40 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-26 07:53:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 07:54:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:54:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 07:54:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:54:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:54:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:54:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:54:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:54:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:54:40 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-26 07:54:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 07:55:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 07:55:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 07:55:37 [DEBUG   ] Got command RPT from MCS: ref #275318
2018-10-26 07:55:37 [DEBUG   ] summary = ERROR
2018-10-26 07:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275318  13 58417 28537325 A  ERRORERROR'
2018-10-26 07:55:37 [DEBUG   ] Got command RPT from MCS: ref #275319
2018-10-26 07:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275319  77 58417 28537326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:55:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 07:55:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:55:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:55:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:55:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:55:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:55:40 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-26 07:55:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 07:56:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 07:56:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 07:56:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:56:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 07:56:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:56:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:56:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:56:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:56:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:56:40 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-10-26 07:56:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:57:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:57:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:57:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 07:57:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:57:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:57:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:57:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:57:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:57:40 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-26 07:57:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:58:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 07:58:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:58:29 [DEBUG   ] Got command RPT from MCS: ref #275339
2018-10-26 07:58:29 [DEBUG   ] summary = ERROR
2018-10-26 07:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275339  13 58417 28709469 A  ERRORERROR'
2018-10-26 07:58:29 [DEBUG   ] Got command RPT from MCS: ref #275340
2018-10-26 07:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275340  77 58417 28709673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:58:29 [DEBUG   ] Got command RPT from MCS: ref #275341
2018-10-26 07:58:29 [DEBUG   ] summary = ERROR
2018-10-26 07:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275341  13 58417 28709877 A  ERRORERROR'
2018-10-26 07:58:30 [DEBUG   ] Got command RPT from MCS: ref #275342
2018-10-26 07:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 07:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275342  77 58417 28710081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 07:58:30 [DEBUG   ] Got command RPT from MCS: ref #275343
2018-10-26 07:58:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 07:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275343  12 58417 28710273 A  ERRORB™™š'
2018-10-26 07:58:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:58:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:58:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:58:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:58:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:58:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:58:40 [DEBUG   ] Finished updating board flags in 1.681 seconds
2018-10-26 07:58:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 07:59:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 07:59:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 07:59:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 07:59:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:59:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:59:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:59:40 [WARNING ] (13, 1, 'bot')
2018-10-26 07:59:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 07:59:40 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-10-26 07:59:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 08:00:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 08:00:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 08:00:37 [DEBUG   ] Got command RPT from MCS: ref #275348
2018-10-26 08:00:37 [DEBUG   ] summary = ERROR
2018-10-26 08:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275348  13 58417 28837321 A  ERRORERROR'
2018-10-26 08:00:37 [DEBUG   ] Got command RPT from MCS: ref #275349
2018-10-26 08:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275349  77 58417 28837322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:00:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:00:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:00:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:00:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:00:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:00:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:00:40 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-10-26 08:00:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 08:01:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:01:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:01:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:01:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:01:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:01:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:01:40 [WARNING ] (13, 1, 'bot')
2018-10-26 08:01:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:01:40 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-26 08:01:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:02:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:02:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:02:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:02:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:02:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:02:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:02:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:02:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:02:41 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-10-26 08:02:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:03:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 08:03:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:03:29 [DEBUG   ] Got command RPT from MCS: ref #275371
2018-10-26 08:03:29 [DEBUG   ] summary = ERROR
2018-10-26 08:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275371  13 58417 29009557 A  ERRORERROR'
2018-10-26 08:03:29 [DEBUG   ] Got command RPT from MCS: ref #275372
2018-10-26 08:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275372  77 58417 29009761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:03:29 [DEBUG   ] Got command RPT from MCS: ref #275373
2018-10-26 08:03:29 [DEBUG   ] summary = ERROR
2018-10-26 08:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275373  13 58417 29009965 A  ERRORERROR'
2018-10-26 08:03:30 [DEBUG   ] Got command RPT from MCS: ref #275375
2018-10-26 08:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275375  77 58417 29010157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:03:30 [DEBUG   ] Got command RPT from MCS: ref #275376
2018-10-26 08:03:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275376  12 58417 29010361 A  ERRORB˜™š'
2018-10-26 08:03:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:03:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:03:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:03:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:03:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:03:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:03:41 [DEBUG   ] Finished updating board flags in 2.132 seconds
2018-10-26 08:03:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:04:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:04:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:04:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:04:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:04:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:04:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:04:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:04:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:04:41 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-26 08:04:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:05:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:05:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:05:37 [DEBUG   ] Got command RPT from MCS: ref #275385
2018-10-26 08:05:37 [DEBUG   ] summary = ERROR
2018-10-26 08:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275385  13 58417 29137325 A  ERRORERROR'
2018-10-26 08:05:37 [DEBUG   ] Got command RPT from MCS: ref #275386
2018-10-26 08:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275386  77 58417 29137326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:05:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:05:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:05:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:05:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:05:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:05:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:05:41 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-10-26 08:05:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:06:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:06:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:06:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:06:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:06:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:06:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:06:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:06:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:06:41 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-26 08:06:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:07:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:07:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:07:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:07:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:07:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:07:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:07:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:07:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:07:41 [DEBUG   ] Finished updating board flags in 2.105 seconds
2018-10-26 08:07:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:08:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:08:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:08:29 [DEBUG   ] Got command RPT from MCS: ref #275406
2018-10-26 08:08:29 [DEBUG   ] summary = ERROR
2018-10-26 08:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275406  13 58417 29309649 A  ERRORERROR'
2018-10-26 08:08:29 [DEBUG   ] Got command RPT from MCS: ref #275407
2018-10-26 08:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275407  77 58417 29309841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:08:30 [DEBUG   ] Got command RPT from MCS: ref #275408
2018-10-26 08:08:30 [DEBUG   ] summary = ERROR
2018-10-26 08:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275408  13 58417 29310045 A  ERRORERROR'
2018-10-26 08:08:30 [DEBUG   ] Got command RPT from MCS: ref #275409
2018-10-26 08:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275409  77 58417 29310249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:08:30 [DEBUG   ] Got command RPT from MCS: ref #275410
2018-10-26 08:08:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275410  12 58417 29310453 A  ERRORB™™š'
2018-10-26 08:08:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:08:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:08:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:08:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:08:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:08:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:08:41 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-10-26 08:08:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:09:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:09:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:09:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:09:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:09:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:09:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:09:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:09:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:09:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:09:41 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-26 08:09:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:10:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:10:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:10:37 [DEBUG   ] Got command RPT from MCS: ref #275411
2018-10-26 08:10:37 [DEBUG   ] summary = ERROR
2018-10-26 08:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275411  13 58417 29437325 A  ERRORERROR'
2018-10-26 08:10:37 [DEBUG   ] Got command RPT from MCS: ref #275412
2018-10-26 08:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275412  77 58417 29437326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:10:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:10:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:10:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:10:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:10:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:10:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:10:41 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-26 08:10:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 08:11:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 08:11:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:11:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:11:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:11:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:11:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:11:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:11:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:11:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:11:41 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-26 08:11:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:12:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 08:12:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 08:12:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:12:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:12:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:12:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:12:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:12:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:12:41 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-26 08:12:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 08:13:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:13:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:13:29 [DEBUG   ] Got command RPT from MCS: ref #275434
2018-10-26 08:13:29 [DEBUG   ] summary = ERROR
2018-10-26 08:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275434  13 58417 29609725 A  ERRORERROR'
2018-10-26 08:13:29 [DEBUG   ] Got command RPT from MCS: ref #275435
2018-10-26 08:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275435  77 58417 29609929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:13:30 [DEBUG   ] Got command RPT from MCS: ref #275436
2018-10-26 08:13:30 [DEBUG   ] summary = ERROR
2018-10-26 08:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275436  13 58417 29610133 A  ERRORERROR'
2018-10-26 08:13:30 [DEBUG   ] Got command RPT from MCS: ref #275438
2018-10-26 08:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275438  77 58417 29610325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:13:30 [DEBUG   ] Got command RPT from MCS: ref #275439
2018-10-26 08:13:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275439  12 58417 29610529 A  ERRORB™™š'
2018-10-26 08:13:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:13:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:13:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:13:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:13:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:13:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:13:41 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-26 08:13:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:14:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:14:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:14:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:14:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:14:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:14:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:14:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:14:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:14:41 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-10-26 08:14:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 08:15:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 08:15:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 08:15:37 [DEBUG   ] Got command RPT from MCS: ref #275448
2018-10-26 08:15:37 [DEBUG   ] summary = ERROR
2018-10-26 08:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275448  13 58417 29737329 A  ERRORERROR'
2018-10-26 08:15:37 [DEBUG   ] Got command RPT from MCS: ref #275449
2018-10-26 08:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275449  77 58417 29737330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:15:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:15:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:15:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:15:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:15:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:15:41 [WARNING ] (13, 1, 'bot')
2018-10-26 08:15:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:15:41 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-10-26 08:15:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 08:16:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 08:16:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 08:16:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:16:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:16:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:16:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:16:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:16:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:16:42 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-10-26 08:16:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 08:17:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 08:17:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 08:17:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:17:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:17:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:17:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:17:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:17:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:17:42 [DEBUG   ] Finished updating board flags in 2.105 seconds
2018-10-26 08:17:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 08:18:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 08:18:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 08:18:29 [DEBUG   ] Got command RPT from MCS: ref #275469
2018-10-26 08:18:29 [DEBUG   ] summary = ERROR
2018-10-26 08:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275469  13 58417 29909813 A  ERRORERROR'
2018-10-26 08:18:30 [DEBUG   ] Got command RPT from MCS: ref #275470
2018-10-26 08:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275470  77 58417 29910017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:18:30 [DEBUG   ] Got command RPT from MCS: ref #275471
2018-10-26 08:18:30 [DEBUG   ] summary = ERROR
2018-10-26 08:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275471  13 58417 29910209 A  ERRORERROR'
2018-10-26 08:18:30 [DEBUG   ] Got command RPT from MCS: ref #275472
2018-10-26 08:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275472  77 58417 29910413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:18:30 [DEBUG   ] Got command RPT from MCS: ref #275473
2018-10-26 08:18:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275473  12 58417 29910617 A  ERRORB˜™š'
2018-10-26 08:18:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:18:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:18:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:18:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:18:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:18:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:18:42 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-26 08:18:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 08:19:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 08:19:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 08:19:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:19:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:19:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:19:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:19:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:19:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:19:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:19:42 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-26 08:19:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 08:20:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 08:20:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 08:20:37 [DEBUG   ] Got command RPT from MCS: ref #275478
2018-10-26 08:20:37 [DEBUG   ] summary = ERROR
2018-10-26 08:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275478  13 58417 30037329 A  ERRORERROR'
2018-10-26 08:20:37 [DEBUG   ] Got command RPT from MCS: ref #275479
2018-10-26 08:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275479  77 58417 30037330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:20:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:20:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:20:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:20:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:20:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:20:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:20:42 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-26 08:20:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:21:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:21:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:21:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:21:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:21:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:21:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:21:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:21:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:21:42 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-10-26 08:21:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:22:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:22:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:22:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:22:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:22:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:22:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:22:42 [WARNING ] (13, 1, 'bot')
2018-10-26 08:22:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:22:42 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-26 08:22:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:23:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:23:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:23:29 [DEBUG   ] Got command RPT from MCS: ref #275501
2018-10-26 08:23:29 [DEBUG   ] summary = ERROR
2018-10-26 08:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275501  13 58417 30209893 A  ERRORERROR'
2018-10-26 08:23:30 [DEBUG   ] Got command RPT from MCS: ref #275502
2018-10-26 08:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275502  77 58417 30210097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:23:30 [DEBUG   ] Got command RPT from MCS: ref #275503
2018-10-26 08:23:30 [DEBUG   ] summary = ERROR
2018-10-26 08:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275503  13 58417 30210301 A  ERRORERROR'
2018-10-26 08:23:30 [DEBUG   ] Got command RPT from MCS: ref #275505
2018-10-26 08:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275505  77 58417 30210505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:23:30 [DEBUG   ] Got command RPT from MCS: ref #275507
2018-10-26 08:23:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275507  12 58417 30210697 A  ERRORB—™š'
2018-10-26 08:23:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:23:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:23:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:23:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:23:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:23:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:23:43 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-26 08:23:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:24:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:24:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:24:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:24:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:24:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:24:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:24:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:24:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:24:43 [DEBUG   ] Finished updating board flags in 2.172 seconds
2018-10-26 08:24:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:25:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:25:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:25:37 [DEBUG   ] Got command RPT from MCS: ref #275511
2018-10-26 08:25:37 [DEBUG   ] summary = ERROR
2018-10-26 08:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275511  13 58417 30337329 A  ERRORERROR'
2018-10-26 08:25:37 [DEBUG   ] Got command RPT from MCS: ref #275512
2018-10-26 08:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275512  77 58417 30337330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 08:25:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:25:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:25:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:25:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:25:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:25:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:25:43 [DEBUG   ] Finished updating board flags in 1.875 seconds
2018-10-26 08:25:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:26:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:26:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:26:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:26:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:26:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:26:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:26:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:26:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:26:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:26:43 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-26 08:26:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:27:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:27:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:27:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:27:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:27:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:27:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:27:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:27:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:27:43 [DEBUG   ] Finished updating board flags in 1.776 seconds
2018-10-26 08:27:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:28:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:28:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:28:29 [DEBUG   ] Got command RPT from MCS: ref #275532
2018-10-26 08:28:29 [DEBUG   ] summary = ERROR
2018-10-26 08:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275532  13 58417 30509981 A  ERRORERROR'
2018-10-26 08:28:30 [DEBUG   ] Got command RPT from MCS: ref #275533
2018-10-26 08:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275533  77 58417 30510185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:28:30 [DEBUG   ] Got command RPT from MCS: ref #275534
2018-10-26 08:28:30 [DEBUG   ] summary = ERROR
2018-10-26 08:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275534  13 58417 30510389 A  ERRORERROR'
2018-10-26 08:28:30 [DEBUG   ] Got command RPT from MCS: ref #275535
2018-10-26 08:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275535  77 58417 30510581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:28:30 [DEBUG   ] Got command RPT from MCS: ref #275536
2018-10-26 08:28:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275536  12 58417 30510785 A  ERRORB˜™š'
2018-10-26 08:28:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 08:28:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:28:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:28:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:28:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:28:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:28:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:28:43 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-26 08:28:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:29:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:29:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:29:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:29:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:29:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:29:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:29:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:29:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:29:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:29:43 [DEBUG   ] Finished updating board flags in 1.699 seconds
2018-10-26 08:29:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 08:30:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:30:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:30:37 [DEBUG   ] Got command RPT from MCS: ref #275541
2018-10-26 08:30:37 [DEBUG   ] summary = ERROR
2018-10-26 08:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275541  13 58417 30637329 A  ERRORERROR'
2018-10-26 08:30:37 [DEBUG   ] Got command RPT from MCS: ref #275542
2018-10-26 08:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275542  77 58417 30637330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:30:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:30:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:30:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:30:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:30:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:30:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:30:43 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-10-26 08:30:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:31:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:31:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:31:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:31:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:31:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:31:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:31:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:31:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:31:43 [DEBUG   ] Finished updating board flags in 1.516 seconds
2018-10-26 08:31:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:32:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:32:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:32:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:32:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:32:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:32:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:32:43 [WARNING ] (13, 1, 'bot')
2018-10-26 08:32:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:32:43 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-10-26 08:32:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:33:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:33:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:33:30 [DEBUG   ] Got command RPT from MCS: ref #275564
2018-10-26 08:33:30 [DEBUG   ] summary = ERROR
2018-10-26 08:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275564  13 58417 30810065 A  ERRORERROR'
2018-10-26 08:33:30 [DEBUG   ] Got command RPT from MCS: ref #275565
2018-10-26 08:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275565  77 58417 30810269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:33:30 [DEBUG   ] Got command RPT from MCS: ref #275566
2018-10-26 08:33:30 [DEBUG   ] summary = ERROR
2018-10-26 08:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275566  13 58417 30810473 A  ERRORERROR'
2018-10-26 08:33:30 [DEBUG   ] Got command RPT from MCS: ref #275568
2018-10-26 08:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275568  77 58417 30810677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:33:30 [DEBUG   ] Got command RPT from MCS: ref #275570
2018-10-26 08:33:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275570  12 58417 30810869 A  ERRORB˜™š'
2018-10-26 08:33:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:33:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:33:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:33:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:33:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:33:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:33:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:33:44 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-10-26 08:33:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:34:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:34:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:34:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 08:34:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:34:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:34:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:34:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:34:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:34:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:34:44 [DEBUG   ] Finished updating board flags in 2.278 seconds
2018-10-26 08:34:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:35:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:35:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:35:37 [DEBUG   ] Got command RPT from MCS: ref #275578
2018-10-26 08:35:37 [DEBUG   ] summary = ERROR
2018-10-26 08:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275578  13 58417 30937329 A  ERRORERROR'
2018-10-26 08:35:37 [DEBUG   ] Got command RPT from MCS: ref #275579
2018-10-26 08:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275579  77 58417 30937330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:35:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:35:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:35:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:35:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:35:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:35:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:35:44 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-10-26 08:35:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:36:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 08:36:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 08:36:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:36:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:36:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:36:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:36:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:36:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:36:44 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-10-26 08:36:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 08:37:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 08:37:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 08:37:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:37:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:37:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:37:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:37:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:37:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:37:44 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 08:37:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 08:38:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 08:38:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:38:30 [DEBUG   ] Got command RPT from MCS: ref #275599
2018-10-26 08:38:30 [DEBUG   ] summary = ERROR
2018-10-26 08:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275599  13 58417 31110153 A  ERRORERROR'
2018-10-26 08:38:30 [DEBUG   ] Got command RPT from MCS: ref #275600
2018-10-26 08:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275600  77 58417 31110357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:38:30 [DEBUG   ] Got command RPT from MCS: ref #275601
2018-10-26 08:38:30 [DEBUG   ] summary = ERROR
2018-10-26 08:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275601  13 58417 31110561 A  ERRORERROR'
2018-10-26 08:38:30 [DEBUG   ] Got command RPT from MCS: ref #275602
2018-10-26 08:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275602  77 58417 31110753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:38:30 [DEBUG   ] Got command RPT from MCS: ref #275603
2018-10-26 08:38:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275603  12 58417 31110957 A  ERRORB˜™š'
2018-10-26 08:38:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:38:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:38:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:38:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:38:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:38:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:38:44 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-26 08:38:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 08:39:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:39:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:39:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:39:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:39:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:39:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:39:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:39:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:39:44 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-26 08:39:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:40:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:40:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:40:37 [DEBUG   ] Got command RPT from MCS: ref #275604
2018-10-26 08:40:37 [DEBUG   ] summary = ERROR
2018-10-26 08:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275604  13 58417 31237329 A  ERRORERROR'
2018-10-26 08:40:37 [DEBUG   ] Got command RPT from MCS: ref #275605
2018-10-26 08:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275605  77 58417 31237330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:40:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 08:40:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:40:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:40:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:40:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:40:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:40:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:40:44 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-26 08:40:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:41:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:41:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:41:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:41:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:41:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:41:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:41:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:41:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:41:44 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-26 08:41:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:42:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:42:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:42:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 08:42:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:42:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:42:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:42:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:42:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:42:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:42:44 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-10-26 08:42:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 08:43:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:43:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:43:30 [DEBUG   ] Got command RPT from MCS: ref #275627
2018-10-26 08:43:30 [DEBUG   ] summary = ERROR
2018-10-26 08:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275627  13 58417 31410241 A  ERRORERROR'
2018-10-26 08:43:30 [DEBUG   ] Got command RPT from MCS: ref #275628
2018-10-26 08:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275628  77 58417 31410445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:43:30 [DEBUG   ] Got command RPT from MCS: ref #275629
2018-10-26 08:43:30 [DEBUG   ] summary = ERROR
2018-10-26 08:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275629  13 58417 31410637 A  ERRORERROR'
2018-10-26 08:43:30 [DEBUG   ] Got command RPT from MCS: ref #275631
2018-10-26 08:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275631  77 58417 31410841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:43:31 [DEBUG   ] Got command RPT from MCS: ref #275632
2018-10-26 08:43:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275632  12 58417 31411045 A  ERRORB˜™š'
2018-10-26 08:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 08:43:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:43:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:43:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:43:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:43:44 [WARNING ] (13, 1, 'bot')
2018-10-26 08:43:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:43:44 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-26 08:43:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:44:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:44:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:44:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:44:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:44:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:44:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:44:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:44:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:44:45 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-10-26 08:44:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:45:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:45:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 08:45:37 [DEBUG   ] Got command RPT from MCS: ref #275641
2018-10-26 08:45:37 [DEBUG   ] summary = ERROR
2018-10-26 08:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275641  13 58417 31537333 A  ERRORERROR'
2018-10-26 08:45:37 [DEBUG   ] Got command RPT from MCS: ref #275642
2018-10-26 08:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275642  77 58417 31537334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:45:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:45:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:45:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:45:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:45:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:45:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:45:45 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-10-26 08:45:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:46:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:46:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:46:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 08:46:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 08:46:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:46:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:46:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:46:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:46:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:46:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:46:45 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-26 08:46:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 08:47:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:47:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:47:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:47:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:47:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:47:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:47:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:47:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:47:45 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-10-26 08:47:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:48:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:48:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:48:30 [DEBUG   ] Got command RPT from MCS: ref #275662
2018-10-26 08:48:30 [DEBUG   ] summary = ERROR
2018-10-26 08:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275662  13 58417 31710321 A  ERRORERROR'
2018-10-26 08:48:30 [DEBUG   ] Got command RPT from MCS: ref #275663
2018-10-26 08:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275663  77 58417 31710525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:48:30 [DEBUG   ] Got command RPT from MCS: ref #275664
2018-10-26 08:48:30 [DEBUG   ] summary = ERROR
2018-10-26 08:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275664  13 58417 31710729 A  ERRORERROR'
2018-10-26 08:48:30 [DEBUG   ] Got command RPT from MCS: ref #275665
2018-10-26 08:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275665  77 58417 31710921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:48:31 [DEBUG   ] Got command RPT from MCS: ref #275666
2018-10-26 08:48:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275666  12 58417 31711125 A  ERRORB˜™š'
2018-10-26 08:48:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:48:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:48:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:48:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:48:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:48:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:48:45 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-10-26 08:48:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:49:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:49:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:49:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:49:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:49:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:49:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:49:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:49:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:49:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:49:45 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-10-26 08:49:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:50:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 08:50:28 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 08:50:37 [DEBUG   ] Got command RPT from MCS: ref #275671
2018-10-26 08:50:37 [DEBUG   ] summary = ERROR
2018-10-26 08:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275671  13 58417 31837329 A  ERRORERROR'
2018-10-26 08:50:37 [DEBUG   ] Got command RPT from MCS: ref #275672
2018-10-26 08:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275672  77 58417 31837330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:50:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:50:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:50:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:50:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:50:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:50:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:50:45 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-26 08:50:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 08:51:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:51:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:51:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:51:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:51:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:51:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:51:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:51:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:51:45 [DEBUG   ] Finished updating board flags in 1.680 seconds
2018-10-26 08:51:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:52:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 08:52:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:52:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:52:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:52:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:52:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:52:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:52:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:52:45 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-26 08:52:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:53:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:53:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 08:53:30 [DEBUG   ] Got command RPT from MCS: ref #275694
2018-10-26 08:53:30 [DEBUG   ] summary = ERROR
2018-10-26 08:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275694  13 58417 32010409 A  ERRORERROR'
2018-10-26 08:53:30 [DEBUG   ] Got command RPT from MCS: ref #275695
2018-10-26 08:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275695  77 58417 32010613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:53:30 [DEBUG   ] Got command RPT from MCS: ref #275696
2018-10-26 08:53:30 [DEBUG   ] summary = ERROR
2018-10-26 08:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275696  13 58417 32010817 A  ERRORERROR'
2018-10-26 08:53:31 [DEBUG   ] Got command RPT from MCS: ref #275698
2018-10-26 08:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275698  77 58417 32011009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:53:31 [DEBUG   ] Got command RPT from MCS: ref #275700
2018-10-26 08:53:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275700  12 58417 32011213 A  ERRORB—™š'
2018-10-26 08:53:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:53:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:53:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:53:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:53:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:53:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:53:45 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-26 08:53:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:54:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 08:54:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:54:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:54:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:54:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:54:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:54:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:54:45 [WARNING ] (13, 1, 'bot')
2018-10-26 08:54:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:54:45 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-26 08:54:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:55:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 08:55:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:55:37 [DEBUG   ] Got command RPT from MCS: ref #275704
2018-10-26 08:55:37 [DEBUG   ] summary = ERROR
2018-10-26 08:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275704  13 58417 32137341 A  ERRORERROR'
2018-10-26 08:55:37 [DEBUG   ] Got command RPT from MCS: ref #275705
2018-10-26 08:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275705  77 58417 32137342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:55:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:55:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:55:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:55:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:55:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:55:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:55:46 [DEBUG   ] Finished updating board flags in 2.256 seconds
2018-10-26 08:55:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 08:56:08 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-26 08:56:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 08:56:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:56:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:56:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:56:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:56:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:56:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:56:46 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-10-26 08:56:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 08:57:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 08:57:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 08:57:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:57:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 08:57:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:57:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:57:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:57:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:57:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:57:46 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-10-26 08:57:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 08:58:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:58:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:58:30 [DEBUG   ] Got command RPT from MCS: ref #275725
2018-10-26 08:58:30 [DEBUG   ] summary = ERROR
2018-10-26 08:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275725  13 58417 32310493 A  ERRORERROR'
2018-10-26 08:58:30 [DEBUG   ] Got command RPT from MCS: ref #275726
2018-10-26 08:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275726  77 58417 32310697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:58:30 [DEBUG   ] Got command RPT from MCS: ref #275727
2018-10-26 08:58:30 [DEBUG   ] summary = ERROR
2018-10-26 08:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275727  13 58417 32310901 A  ERRORERROR'
2018-10-26 08:58:31 [DEBUG   ] Got command RPT from MCS: ref #275728
2018-10-26 08:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 08:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275728  77 58417 32311093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 08:58:31 [DEBUG   ] Got command RPT from MCS: ref #275729
2018-10-26 08:58:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 08:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275729  12 58417 32311297 A  ERRORB˜™š'
2018-10-26 08:58:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:58:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 08:58:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:58:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:58:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:58:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:58:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:58:46 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 08:58:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:59:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 08:59:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 08:59:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 08:59:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:59:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:59:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:59:46 [WARNING ] (13, 1, 'bot')
2018-10-26 08:59:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 08:59:46 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-26 08:59:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 09:00:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 09:00:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:00:37 [DEBUG   ] Got command RPT from MCS: ref #275734
2018-10-26 09:00:37 [DEBUG   ] summary = ERROR
2018-10-26 09:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275734  13 58417 32437341 A  ERRORERROR'
2018-10-26 09:00:37 [DEBUG   ] Got command RPT from MCS: ref #275735
2018-10-26 09:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275735  77 58417 32437342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:00:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:00:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 09:00:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:00:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:00:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:00:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:00:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:00:46 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-10-26 09:00:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 09:01:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 09:01:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:01:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:01:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:01:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:01:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:01:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:01:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:01:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:01:46 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-26 09:01:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:02:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:02:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:02:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:02:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:02:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:02:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:02:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:02:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:02:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:02:46 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-10-26 09:02:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:03:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:03:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:03:30 [DEBUG   ] Got command RPT from MCS: ref #275757
2018-10-26 09:03:30 [DEBUG   ] summary = ERROR
2018-10-26 09:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275757  13 58417 32610581 A  ERRORERROR'
2018-10-26 09:03:30 [DEBUG   ] Got command RPT from MCS: ref #275758
2018-10-26 09:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275758  77 58417 32610785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:03:30 [DEBUG   ] Got command RPT from MCS: ref #275759
2018-10-26 09:03:30 [DEBUG   ] summary = ERROR
2018-10-26 09:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275759  13 58417 32610977 A  ERRORERROR'
2018-10-26 09:03:31 [DEBUG   ] Got command RPT from MCS: ref #275761
2018-10-26 09:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275761  77 58417 32611181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:03:31 [DEBUG   ] Got command RPT from MCS: ref #275763
2018-10-26 09:03:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275763  12 58417 32611385 A  ERRORB™™š'
2018-10-26 09:03:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:03:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 09:03:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:03:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:03:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:03:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:03:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:03:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:03:46 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-10-26 09:03:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 09:04:09 [DEBUG   ] Finished updating ant stats in 0.989 seconds
2018-10-26 09:04:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:04:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:04:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:04:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:04:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:04:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:04:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:04:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:04:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:04:46 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-26 09:04:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 09:05:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:05:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 09:05:37 [DEBUG   ] Got command RPT from MCS: ref #275771
2018-10-26 09:05:37 [DEBUG   ] summary = ERROR
2018-10-26 09:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275771  13 58417 32737337 A  ERRORERROR'
2018-10-26 09:05:37 [DEBUG   ] Got command RPT from MCS: ref #275772
2018-10-26 09:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275772  77 58417 32737338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:05:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:05:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:05:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:05:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:05:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:05:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:05:46 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-10-26 09:05:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:06:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:06:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 09:06:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:06:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:06:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:06:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:06:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:06:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:06:46 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-10-26 09:06:49 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 09:07:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 09:07:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 09:07:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:07:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:07:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:07:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:07:46 [WARNING ] (13, 1, 'bot')
2018-10-26 09:07:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:07:46 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-10-26 09:07:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 09:08:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:08:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 09:08:30 [DEBUG   ] Got command RPT from MCS: ref #275792
2018-10-26 09:08:30 [DEBUG   ] summary = ERROR
2018-10-26 09:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275792  13 58417 32910665 A  ERRORERROR'
2018-10-26 09:08:30 [DEBUG   ] Got command RPT from MCS: ref #275793
2018-10-26 09:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275793  77 58417 32910869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:08:31 [DEBUG   ] Got command RPT from MCS: ref #275794
2018-10-26 09:08:31 [DEBUG   ] summary = ERROR
2018-10-26 09:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275794  13 58417 32911073 A  ERRORERROR'
2018-10-26 09:08:31 [DEBUG   ] Got command RPT from MCS: ref #275795
2018-10-26 09:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275795  77 58417 32911265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:08:31 [DEBUG   ] Got command RPT from MCS: ref #275796
2018-10-26 09:08:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275796  12 58417 32911469 A  ERRORB˜™š'
2018-10-26 09:08:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:08:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:08:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:08:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:08:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:08:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:08:47 [DEBUG   ] Finished updating board flags in 2.174 seconds
2018-10-26 09:08:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 09:09:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:09:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:09:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:09:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:09:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:09:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:09:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:09:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:09:47 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-26 09:09:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 09:10:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 09:10:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:10:37 [DEBUG   ] Got command RPT from MCS: ref #275797
2018-10-26 09:10:37 [DEBUG   ] summary = ERROR
2018-10-26 09:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275797  13 58417 33037345 A  ERRORERROR'
2018-10-26 09:10:37 [DEBUG   ] Got command RPT from MCS: ref #275798
2018-10-26 09:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275798  77 58417 33037346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:10:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:10:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:10:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:10:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:10:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:10:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:10:47 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-26 09:10:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:11:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:11:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:11:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:11:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:11:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:11:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:11:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:11:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:11:47 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-10-26 09:11:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:12:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 09:12:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:12:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:12:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:12:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:12:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:12:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:12:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:12:47 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-26 09:12:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:13:10 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 09:13:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:13:30 [DEBUG   ] Got command RPT from MCS: ref #275820
2018-10-26 09:13:30 [DEBUG   ] summary = ERROR
2018-10-26 09:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275820  13 58417 33210749 A  ERRORERROR'
2018-10-26 09:13:30 [DEBUG   ] Got command RPT from MCS: ref #275821
2018-10-26 09:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275821  77 58417 33210953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:13:31 [DEBUG   ] Got command RPT from MCS: ref #275822
2018-10-26 09:13:31 [DEBUG   ] summary = ERROR
2018-10-26 09:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275822  13 58417 33211145 A  ERRORERROR'
2018-10-26 09:13:31 [DEBUG   ] Got command RPT from MCS: ref #275823
2018-10-26 09:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275823  77 58417 33211349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:13:31 [DEBUG   ] Got command RPT from MCS: ref #275825
2018-10-26 09:13:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275825  12 58417 33211553 A  ERRORB˜™š'
2018-10-26 09:13:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:13:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:13:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:13:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:13:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:13:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:13:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:13:47 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-26 09:13:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 09:14:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:14:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:14:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:14:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:14:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:14:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:14:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:14:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:14:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:14:47 [DEBUG   ] Finished updating board flags in 1.847 seconds
2018-10-26 09:14:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 09:15:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 09:15:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 09:15:37 [DEBUG   ] Got command RPT from MCS: ref #275834
2018-10-26 09:15:37 [DEBUG   ] summary = ERROR
2018-10-26 09:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275834  13 58417 33337341 A  ERRORERROR'
2018-10-26 09:15:37 [DEBUG   ] Got command RPT from MCS: ref #275835
2018-10-26 09:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275835  77 58417 33337342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:15:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:15:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:15:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:15:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:15:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:15:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:15:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:15:47 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-10-26 09:15:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 09:16:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 09:16:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 09:16:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:16:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:16:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:16:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:16:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:16:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:16:47 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-26 09:16:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 09:17:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 09:17:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 09:17:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:17:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:17:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:17:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:17:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:17:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:17:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:17:47 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-26 09:17:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:18:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 09:18:30 [DEBUG   ] Got command RPT from MCS: ref #275855
2018-10-26 09:18:30 [DEBUG   ] summary = ERROR
2018-10-26 09:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275855  13 58417 33510833 A  ERRORERROR'
2018-10-26 09:18:31 [DEBUG   ] Got command RPT from MCS: ref #275856
2018-10-26 09:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275856  77 58417 33511037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:18:31 [DEBUG   ] Got command RPT from MCS: ref #275857
2018-10-26 09:18:31 [DEBUG   ] summary = ERROR
2018-10-26 09:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275857  13 58417 33511241 A  ERRORERROR'
2018-10-26 09:18:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:18:31 [DEBUG   ] Got command RPT from MCS: ref #275858
2018-10-26 09:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275858  77 58417 33511433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:18:31 [DEBUG   ] Got command RPT from MCS: ref #275859
2018-10-26 09:18:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275859  12 58417 33511637 A  ERRORB™™š'
2018-10-26 09:18:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:18:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:18:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:18:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:18:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:18:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:18:47 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-26 09:18:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 09:19:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:19:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:19:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:19:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:19:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:19:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:19:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:19:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:19:47 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 09:19:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 09:20:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 09:20:31 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-26 09:20:37 [DEBUG   ] Got command RPT from MCS: ref #275864
2018-10-26 09:20:37 [DEBUG   ] summary = ERROR
2018-10-26 09:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275864  13 58417 33637341 A  ERRORERROR'
2018-10-26 09:20:37 [DEBUG   ] Got command RPT from MCS: ref #275865
2018-10-26 09:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275865  77 58417 33637342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:20:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:20:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:20:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:20:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:20:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:20:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:20:47 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-10-26 09:20:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:21:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:21:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:21:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:21:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:21:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:21:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:21:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:21:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:21:47 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 09:21:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:22:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:22:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:22:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-26 09:22:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:22:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:22:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:22:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:22:47 [WARNING ] (13, 1, 'bot')
2018-10-26 09:22:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:22:47 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-26 09:22:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:23:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:23:30 [DEBUG   ] Got command RPT from MCS: ref #275887
2018-10-26 09:23:30 [DEBUG   ] summary = ERROR
2018-10-26 09:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275887  13 58417 33810925 A  ERRORERROR'
2018-10-26 09:23:31 [DEBUG   ] Got command RPT from MCS: ref #275888
2018-10-26 09:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275888  77 58417 33811117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:23:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:23:31 [DEBUG   ] Got command RPT from MCS: ref #275889
2018-10-26 09:23:31 [DEBUG   ] summary = ERROR
2018-10-26 09:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275889  13 58417 33811321 A  ERRORERROR'
2018-10-26 09:23:31 [DEBUG   ] Got command RPT from MCS: ref #275891
2018-10-26 09:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275891  77 58417 33811525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:23:31 [DEBUG   ] Got command RPT from MCS: ref #275892
2018-10-26 09:23:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275892  12 58417 33811729 A  ERRORB˜™š'
2018-10-26 09:23:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:23:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:23:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:23:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:23:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:23:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:23:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:23:48 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-10-26 09:23:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:24:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 09:24:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:24:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:24:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:24:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:24:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:24:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:24:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:24:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:24:48 [DEBUG   ] Finished updating board flags in 2.075 seconds
2018-10-26 09:24:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:25:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:25:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 09:25:37 [DEBUG   ] Got command RPT from MCS: ref #275897
2018-10-26 09:25:37 [DEBUG   ] summary = ERROR
2018-10-26 09:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275897  13 58417 33937349 A  ERRORERROR'
2018-10-26 09:25:37 [DEBUG   ] Got command RPT from MCS: ref #275898
2018-10-26 09:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275898  77 58417 33937350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:25:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:25:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:25:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:25:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:25:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:25:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:25:48 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-26 09:25:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 09:26:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 09:26:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:26:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:26:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:26:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:26:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:26:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:26:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:26:48 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 09:26:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:27:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:27:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:27:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:27:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:27:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:27:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:27:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:27:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:27:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:27:48 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-26 09:27:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 09:28:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 09:28:31 [DEBUG   ] Got command RPT from MCS: ref #275918
2018-10-26 09:28:31 [DEBUG   ] summary = ERROR
2018-10-26 09:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275918  13 58417 34111001 A  ERRORERROR'
2018-10-26 09:28:31 [DEBUG   ] Got command RPT from MCS: ref #275919
2018-10-26 09:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275919  77 58417 34111205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:28:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:28:31 [DEBUG   ] Got command RPT from MCS: ref #275920
2018-10-26 09:28:31 [DEBUG   ] summary = ERROR
2018-10-26 09:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275920  13 58417 34111409 A  ERRORERROR'
2018-10-26 09:28:31 [DEBUG   ] Got command RPT from MCS: ref #275921
2018-10-26 09:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275921  77 58417 34111601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:28:31 [DEBUG   ] Got command RPT from MCS: ref #275922
2018-10-26 09:28:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275922  12 58417 34111805 A  ERRORB—™š'
2018-10-26 09:28:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:28:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:28:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:28:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:28:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:28:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:28:48 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-26 09:28:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:29:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:29:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:29:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:29:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:29:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:29:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:29:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:29:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:29:48 [DEBUG   ] Finished updating board flags in 1.889 seconds
2018-10-26 09:29:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:30:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:30:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:30:37 [DEBUG   ] Got command RPT from MCS: ref #275927
2018-10-26 09:30:37 [DEBUG   ] summary = ERROR
2018-10-26 09:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275927  13 58417 34237349 A  ERRORERROR'
2018-10-26 09:30:37 [DEBUG   ] Got command RPT from MCS: ref #275928
2018-10-26 09:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275928  77 58417 34237350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:30:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:30:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:30:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:30:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:30:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:30:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:30:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:30:48 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-26 09:30:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:31:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:31:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 09:31:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:31:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 09:31:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:31:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:31:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:31:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:31:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:31:48 [DEBUG   ] Finished updating board flags in 1.700 seconds
2018-10-26 09:31:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:32:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:32:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:32:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:32:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:32:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 09:32:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:32:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:32:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:32:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:32:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:32:48 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-26 09:32:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:33:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:33:31 [DEBUG   ] Got command RPT from MCS: ref #275950
2018-10-26 09:33:31 [DEBUG   ] summary = ERROR
2018-10-26 09:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275950  13 58417 34411093 A  ERRORERROR'
2018-10-26 09:33:31 [DEBUG   ] Got command RPT from MCS: ref #275951
2018-10-26 09:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275951  77 58417 34411285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:33:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:33:31 [DEBUG   ] Got command RPT from MCS: ref #275952
2018-10-26 09:33:31 [DEBUG   ] summary = ERROR
2018-10-26 09:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275952  13 58417 34411489 A  ERRORERROR'
2018-10-26 09:33:31 [DEBUG   ] Got command RPT from MCS: ref #275954
2018-10-26 09:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275954  77 58417 34411693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:33:31 [DEBUG   ] Got command RPT from MCS: ref #275956
2018-10-26 09:33:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275956  12 58417 34411897 A  ERRORB˜™š'
2018-10-26 09:33:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 09:33:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:33:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:33:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:33:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:33:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:33:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:33:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:33:48 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-26 09:33:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:34:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 09:34:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:34:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:34:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:34:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:34:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:34:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:34:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:34:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:34:48 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-26 09:34:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:35:11 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-26 09:35:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 09:35:37 [DEBUG   ] Got command RPT from MCS: ref #275964
2018-10-26 09:35:37 [DEBUG   ] summary = ERROR
2018-10-26 09:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275964  13 58417 34537349 A  ERRORERROR'
2018-10-26 09:35:37 [DEBUG   ] Got command RPT from MCS: ref #275965
2018-10-26 09:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275965  77 58417 34537350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:35:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:35:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:35:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:35:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:35:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:35:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:35:48 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-10-26 09:35:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 09:36:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 09:36:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 09:36:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:36:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:36:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:36:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:36:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:36:48 [WARNING ] (13, 1, 'bot')
2018-10-26 09:36:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:36:48 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-26 09:36:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 09:37:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 09:37:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 09:37:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:37:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:37:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:37:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:37:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:37:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:37:49 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-10-26 09:37:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:38:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:38:31 [DEBUG   ] Got command RPT from MCS: ref #275985
2018-10-26 09:38:31 [DEBUG   ] summary = ERROR
2018-10-26 09:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275985  13 58417 34711169 A  ERRORERROR'
2018-10-26 09:38:31 [DEBUG   ] Got command RPT from MCS: ref #275986
2018-10-26 09:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275986  77 58417 34711374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:38:31 [DEBUG   ] Got command RPT from MCS: ref #275987
2018-10-26 09:38:31 [DEBUG   ] summary = ERROR
2018-10-26 09:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275987  13 58417 34711577 A  ERRORERROR'
2018-10-26 09:38:31 [DEBUG   ] Got command RPT from MCS: ref #275988
2018-10-26 09:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275988  77 58417 34711781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:38:31 [DEBUG   ] Got command RPT from MCS: ref #275989
2018-10-26 09:38:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275989  12 58417 34711973 A  ERRORB˜™š'
2018-10-26 09:38:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:38:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:38:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:38:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:38:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:38:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:38:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:38:49 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-26 09:38:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:39:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:39:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:39:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:39:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:39:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:39:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:39:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:39:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:39:49 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-26 09:39:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:40:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 09:40:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:40:37 [DEBUG   ] Got command RPT from MCS: ref #275990
2018-10-26 09:40:37 [DEBUG   ] summary = ERROR
2018-10-26 09:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275990  13 58417 34837345 A  ERRORERROR'
2018-10-26 09:40:37 [DEBUG   ] Got command RPT from MCS: ref #275991
2018-10-26 09:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   275991  77 58417 34837346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:40:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:40:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:40:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:40:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:40:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:40:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:40:49 [DEBUG   ] Finished updating board flags in 1.862 seconds
2018-10-26 09:40:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:41:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 09:41:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:41:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:41:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:41:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:41:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:41:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:41:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:41:49 [DEBUG   ] Finished updating board flags in 1.741 seconds
2018-10-26 09:41:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:42:12 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2018-10-26 09:42:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 09:42:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:42:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:42:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:42:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:42:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:42:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:42:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:42:49 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-26 09:42:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 09:43:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:43:31 [DEBUG   ] Got command RPT from MCS: ref #276013
2018-10-26 09:43:31 [DEBUG   ] summary = ERROR
2018-10-26 09:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276013  13 58417 35011261 A  ERRORERROR'
2018-10-26 09:43:31 [DEBUG   ] Got command RPT from MCS: ref #276014
2018-10-26 09:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276014  77 58417 35011465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:43:31 [DEBUG   ] Got command RPT from MCS: ref #276015
2018-10-26 09:43:31 [DEBUG   ] summary = ERROR
2018-10-26 09:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276015  13 58417 35011657 A  ERRORERROR'
2018-10-26 09:43:31 [DEBUG   ] Got command RPT from MCS: ref #276017
2018-10-26 09:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276017  77 58417 35011861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:43:32 [DEBUG   ] Got command RPT from MCS: ref #276018
2018-10-26 09:43:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276018  12 58417 35012065 A  ERRORB—™š'
2018-10-26 09:43:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:43:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:43:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:43:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:43:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:43:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:43:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:43:49 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-10-26 09:43:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:44:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 09:44:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 09:44:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:44:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:44:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:44:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:44:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:44:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:44:49 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-10-26 09:44:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 09:45:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 09:45:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 09:45:37 [DEBUG   ] Got command RPT from MCS: ref #276027
2018-10-26 09:45:37 [DEBUG   ] summary = ERROR
2018-10-26 09:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276027  13 58417 35137353 A  ERRORERROR'
2018-10-26 09:45:37 [DEBUG   ] Got command RPT from MCS: ref #276028
2018-10-26 09:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276028  77 58417 35137354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:45:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:45:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:45:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:45:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:45:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:45:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:45:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:45:49 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-26 09:45:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 09:46:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 09:46:33 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 09:46:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:46:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:46:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:46:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:46:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:46:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:46:49 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-10-26 09:46:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:47:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:47:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:47:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:47:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:47:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:47:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:47:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:47:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:47:49 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-26 09:47:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:48:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:48:31 [DEBUG   ] Got command RPT from MCS: ref #276048
2018-10-26 09:48:31 [DEBUG   ] summary = ERROR
2018-10-26 09:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276048  13 58417 35311341 A  ERRORERROR'
2018-10-26 09:48:31 [DEBUG   ] Got command RPT from MCS: ref #276049
2018-10-26 09:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276049  77 58417 35311545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:48:31 [DEBUG   ] Got command RPT from MCS: ref #276050
2018-10-26 09:48:31 [DEBUG   ] summary = ERROR
2018-10-26 09:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276050  13 58417 35311749 A  ERRORERROR'
2018-10-26 09:48:31 [DEBUG   ] Got command RPT from MCS: ref #276051
2018-10-26 09:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276051  77 58417 35311941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:48:32 [DEBUG   ] Got command RPT from MCS: ref #276052
2018-10-26 09:48:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276052  12 58417 35312145 A  ERRORB™™š'
2018-10-26 09:48:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:48:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:48:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:48:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:48:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:48:49 [WARNING ] (13, 1, 'bot')
2018-10-26 09:48:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:48:49 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-26 09:48:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 09:49:13 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 09:49:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:49:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:49:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 09:49:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 09:49:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:49:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:49:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:49:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:49:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:49:50 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-10-26 09:49:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:50:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:50:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 09:50:37 [DEBUG   ] Got command RPT from MCS: ref #276057
2018-10-26 09:50:37 [DEBUG   ] summary = ERROR
2018-10-26 09:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276057  13 58417 35437349 A  ERRORERROR'
2018-10-26 09:50:37 [DEBUG   ] Got command RPT from MCS: ref #276058
2018-10-26 09:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276058  77 58417 35437350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:50:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:50:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:50:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:50:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:50:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:50:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:50:50 [DEBUG   ] Finished updating board flags in 2.271 seconds
2018-10-26 09:50:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 09:51:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 09:51:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 09:51:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:51:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:51:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:51:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:51:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:51:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:51:50 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-10-26 09:51:53 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-26 09:52:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 09:52:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 09:52:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:52:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:52:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:52:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:52:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:52:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:52:50 [DEBUG   ] Finished updating board flags in 2.100 seconds
2018-10-26 09:52:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 09:53:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 09:53:31 [DEBUG   ] Got command RPT from MCS: ref #276080
2018-10-26 09:53:31 [DEBUG   ] summary = ERROR
2018-10-26 09:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276080  13 58417 35611429 A  ERRORERROR'
2018-10-26 09:53:31 [DEBUG   ] Got command RPT from MCS: ref #276081
2018-10-26 09:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276081  77 58417 35611633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:53:31 [DEBUG   ] Got command RPT from MCS: ref #276082
2018-10-26 09:53:31 [DEBUG   ] summary = ERROR
2018-10-26 09:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276082  13 58417 35611837 A  ERRORERROR'
2018-10-26 09:53:32 [DEBUG   ] Got command RPT from MCS: ref #276084
2018-10-26 09:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276084  77 58417 35612029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:53:32 [DEBUG   ] Got command RPT from MCS: ref #276086
2018-10-26 09:53:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276086  12 58417 35612233 A  ERRORB˜™š'
2018-10-26 09:53:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 09:53:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 09:53:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:53:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:53:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:53:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:53:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:53:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:53:50 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-26 09:53:54 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-26 09:54:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:54:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:54:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:54:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:54:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:54:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:54:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:54:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:54:50 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-26 09:54:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:55:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 09:55:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 09:55:37 [DEBUG   ] Got command RPT from MCS: ref #276090
2018-10-26 09:55:37 [DEBUG   ] summary = ERROR
2018-10-26 09:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276090  13 58417 35737357 A  ERRORERROR'
2018-10-26 09:55:37 [DEBUG   ] Got command RPT from MCS: ref #276091
2018-10-26 09:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276091  77 58417 35737358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:55:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:55:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:55:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:55:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:55:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:55:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:55:50 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 09:55:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 09:56:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 09:56:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 09:56:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:56:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:56:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:56:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:56:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:56:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:56:50 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-26 09:56:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:57:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 09:57:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 09:57:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:57:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:57:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:57:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:57:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:57:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:57:50 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-26 09:57:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 09:58:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:58:31 [DEBUG   ] Got command RPT from MCS: ref #276111
2018-10-26 09:58:31 [DEBUG   ] summary = ERROR
2018-10-26 09:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276111  13 58417 35911517 A  ERRORERROR'
2018-10-26 09:58:31 [DEBUG   ] Got command RPT from MCS: ref #276112
2018-10-26 09:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276112  77 58417 35911721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:58:31 [DEBUG   ] Got command RPT from MCS: ref #276113
2018-10-26 09:58:31 [DEBUG   ] summary = ERROR
2018-10-26 09:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276113  13 58417 35911913 A  ERRORERROR'
2018-10-26 09:58:32 [DEBUG   ] Got command RPT from MCS: ref #276114
2018-10-26 09:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 09:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276114  77 58417 35912117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 09:58:32 [DEBUG   ] Got command RPT from MCS: ref #276115
2018-10-26 09:58:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 09:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276115  12 58417 35912321 A  ERRORB—™š'
2018-10-26 09:58:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 09:58:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:58:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:58:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:58:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:58:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:58:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:58:50 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 09:58:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 09:59:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 09:59:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 09:59:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 09:59:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:59:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:59:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:59:50 [WARNING ] (13, 1, 'bot')
2018-10-26 09:59:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 09:59:50 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-26 09:59:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 10:00:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 10:00:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 10:00:37 [DEBUG   ] Got command RPT from MCS: ref #276120
2018-10-26 10:00:37 [DEBUG   ] summary = ERROR
2018-10-26 10:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276120  13 58417 36037349 A  ERRORERROR'
2018-10-26 10:00:37 [DEBUG   ] Got command RPT from MCS: ref #276121
2018-10-26 10:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276121  77 58417 36037350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:00:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:00:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:00:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:00:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:00:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:00:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:00:50 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-26 10:00:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:01:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:01:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 10:01:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 10:01:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:01:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:01:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:01:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:01:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:01:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:01:50 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-26 10:01:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:02:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:02:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:02:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:02:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:02:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:02:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:02:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:02:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:02:50 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-26 10:02:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 10:03:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:03:31 [DEBUG   ] Got command RPT from MCS: ref #276143
2018-10-26 10:03:31 [DEBUG   ] summary = ERROR
2018-10-26 10:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276143  13 58417 36211597 A  ERRORERROR'
2018-10-26 10:03:31 [DEBUG   ] Got command RPT from MCS: ref #276144
2018-10-26 10:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276144  77 58417 36211801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:03:32 [DEBUG   ] Got command RPT from MCS: ref #276145
2018-10-26 10:03:32 [DEBUG   ] summary = ERROR
2018-10-26 10:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276145  13 58417 36212005 A  ERRORERROR'
2018-10-26 10:03:32 [DEBUG   ] Got command RPT from MCS: ref #276147
2018-10-26 10:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276147  77 58417 36212209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:03:32 [DEBUG   ] Got command RPT from MCS: ref #276149
2018-10-26 10:03:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276149  12 58417 36212401 A  ERRORB˜™š'
2018-10-26 10:03:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:03:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:03:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:03:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:03:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:03:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:03:50 [WARNING ] (13, 1, 'bot')
2018-10-26 10:03:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:03:50 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-26 10:03:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:04:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:04:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:04:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:04:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:04:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:04:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:04:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:04:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:04:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:04:51 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-10-26 10:04:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:05:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 10:05:35 [DEBUG   ] Finished updating ant stats in 0.751 seconds
2018-10-26 10:05:37 [DEBUG   ] Got command RPT from MCS: ref #276157
2018-10-26 10:05:37 [DEBUG   ] summary = ERROR
2018-10-26 10:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276157  13 58417 36337361 A  ERRORERROR'
2018-10-26 10:05:37 [DEBUG   ] Got command RPT from MCS: ref #276158
2018-10-26 10:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276158  77 58417 36337362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:05:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:05:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:05:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:05:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:05:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:05:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:05:51 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-10-26 10:05:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:06:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:06:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 10:06:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:06:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:06:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:06:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:06:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:06:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:06:51 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-26 10:06:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 10:07:16 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-26 10:07:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 10:07:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:07:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:07:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:07:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:07:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:07:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:07:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:07:51 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-26 10:07:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 10:08:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:08:31 [DEBUG   ] Got command RPT from MCS: ref #276178
2018-10-26 10:08:31 [DEBUG   ] summary = ERROR
2018-10-26 10:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276178  13 58417 36511689 A  ERRORERROR'
2018-10-26 10:08:31 [DEBUG   ] Got command RPT from MCS: ref #276179
2018-10-26 10:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276179  77 58417 36511893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:08:32 [DEBUG   ] Got command RPT from MCS: ref #276180
2018-10-26 10:08:32 [DEBUG   ] summary = ERROR
2018-10-26 10:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276180  13 58417 36512085 A  ERRORERROR'
2018-10-26 10:08:32 [DEBUG   ] Got command RPT from MCS: ref #276181
2018-10-26 10:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276181  77 58417 36512289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:08:32 [DEBUG   ] Got command RPT from MCS: ref #276182
2018-10-26 10:08:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276182  12 58417 36512493 A  ERRORB˜™š'
2018-10-26 10:08:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:08:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:08:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:08:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:08:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:08:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:08:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:08:51 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-26 10:08:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:09:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 10:09:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:09:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:09:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:09:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:09:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:09:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:09:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:09:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:09:51 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-26 10:09:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 10:10:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 10:10:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:10:37 [DEBUG   ] Got command RPT from MCS: ref #276183
2018-10-26 10:10:37 [DEBUG   ] summary = ERROR
2018-10-26 10:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276183  13 58417 36637361 A  ERRORERROR'
2018-10-26 10:10:37 [DEBUG   ] Got command RPT from MCS: ref #276184
2018-10-26 10:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276184  77 58417 36637362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:10:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:10:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:10:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:10:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:10:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:10:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:10:51 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-26 10:10:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:11:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:11:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:11:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:11:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:11:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:11:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:11:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:11:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:11:51 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-10-26 10:11:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:12:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:12:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:12:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:12:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:12:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:12:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:12:51 [WARNING ] (13, 1, 'bot')
2018-10-26 10:12:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:12:51 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-10-26 10:12:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:13:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 10:13:31 [DEBUG   ] Got command RPT from MCS: ref #276206
2018-10-26 10:13:31 [DEBUG   ] summary = ERROR
2018-10-26 10:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276206  13 58417 36811765 A  ERRORERROR'
2018-10-26 10:13:31 [DEBUG   ] Got command RPT from MCS: ref #276207
2018-10-26 10:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276207  77 58417 36811969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:13:32 [DEBUG   ] Got command RPT from MCS: ref #276208
2018-10-26 10:13:32 [DEBUG   ] summary = ERROR
2018-10-26 10:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276208  13 58417 36812173 A  ERRORERROR'
2018-10-26 10:13:32 [DEBUG   ] Got command RPT from MCS: ref #276210
2018-10-26 10:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276210  77 58417 36812377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:13:32 [DEBUG   ] Got command RPT from MCS: ref #276211
2018-10-26 10:13:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276211  12 58417 36812569 A  ERRORB˜™š'
2018-10-26 10:13:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 10:13:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:13:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:13:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:13:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:13:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:13:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:13:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:13:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:13:52 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-10-26 10:13:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 10:14:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 10:14:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 10:14:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:14:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:14:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:14:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:14:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:14:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:14:52 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-10-26 10:14:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 10:15:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:15:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 10:15:37 [DEBUG   ] Got command RPT from MCS: ref #276220
2018-10-26 10:15:37 [DEBUG   ] summary = ERROR
2018-10-26 10:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276220  13 58417 36937361 A  ERRORERROR'
2018-10-26 10:15:37 [DEBUG   ] Got command RPT from MCS: ref #276221
2018-10-26 10:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276221  77 58417 36937362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:15:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:15:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:15:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:15:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:15:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:15:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:15:52 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-10-26 10:15:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:16:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:16:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:16:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:16:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:16:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:16:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:16:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:16:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:16:52 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-26 10:16:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 10:17:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 10:17:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 10:17:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 10:17:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:17:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:17:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:17:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:17:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:17:52 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-26 10:17:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:18:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 10:18:31 [DEBUG   ] Got command RPT from MCS: ref #276241
2018-10-26 10:18:31 [DEBUG   ] summary = ERROR
2018-10-26 10:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276241  13 58417 37111853 A  ERRORERROR'
2018-10-26 10:18:32 [DEBUG   ] Got command RPT from MCS: ref #276242
2018-10-26 10:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276242  77 58417 37112057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:18:32 [DEBUG   ] Got command RPT from MCS: ref #276243
2018-10-26 10:18:32 [DEBUG   ] summary = ERROR
2018-10-26 10:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276243  13 58417 37112261 A  ERRORERROR'
2018-10-26 10:18:32 [DEBUG   ] Got command RPT from MCS: ref #276244
2018-10-26 10:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276244  77 58417 37112465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:18:32 [DEBUG   ] Got command RPT from MCS: ref #276245
2018-10-26 10:18:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276245  12 58417 37112657 A  ERRORB™™š'
2018-10-26 10:18:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 10:18:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 10:18:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:18:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:18:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:18:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:18:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:18:52 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-26 10:18:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:19:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:19:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:19:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:19:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:19:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:19:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:19:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:19:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:19:52 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 10:19:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:20:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:20:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:20:37 [DEBUG   ] Got command RPT from MCS: ref #276250
2018-10-26 10:20:37 [DEBUG   ] summary = ERROR
2018-10-26 10:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276250  13 58417 37237365 A  ERRORERROR'
2018-10-26 10:20:37 [DEBUG   ] Got command RPT from MCS: ref #276251
2018-10-26 10:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276251  77 58417 37237366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:20:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:20:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:20:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:20:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:20:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:20:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:20:52 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-26 10:20:57 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 10:21:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 10:21:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 10:21:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:21:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:21:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:21:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:21:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:21:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:21:52 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-26 10:21:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 10:22:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:22:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:22:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:22:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:22:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:22:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:22:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:22:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:22:52 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-10-26 10:22:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 10:23:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:23:31 [DEBUG   ] Got command RPT from MCS: ref #276273
2018-10-26 10:23:31 [DEBUG   ] summary = ERROR
2018-10-26 10:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276273  13 58417 37411937 A  ERRORERROR'
2018-10-26 10:23:32 [DEBUG   ] Got command RPT from MCS: ref #276274
2018-10-26 10:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276274  77 58417 37412141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:23:32 [DEBUG   ] Got command RPT from MCS: ref #276275
2018-10-26 10:23:32 [DEBUG   ] summary = ERROR
2018-10-26 10:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276275  13 58417 37412345 A  ERRORERROR'
2018-10-26 10:23:32 [DEBUG   ] Got command RPT from MCS: ref #276277
2018-10-26 10:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276277  77 58417 37412549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:23:32 [DEBUG   ] Got command RPT from MCS: ref #276279
2018-10-26 10:23:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276279  12 58417 37412741 A  ERRORB˜™š'
2018-10-26 10:23:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:23:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:23:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:23:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:23:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:23:52 [WARNING ] (13, 1, 'bot')
2018-10-26 10:23:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:23:52 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-10-26 10:23:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:24:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 10:24:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 10:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:24:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:24:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:24:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:24:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:24:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:24:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:24:53 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-10-26 10:24:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:25:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:25:37 [DEBUG   ] Got command RPT from MCS: ref #276283
2018-10-26 10:25:37 [DEBUG   ] summary = ERROR
2018-10-26 10:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276283  13 58417 37537361 A  ERRORERROR'
2018-10-26 10:25:37 [DEBUG   ] Got command RPT from MCS: ref #276284
2018-10-26 10:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276284  77 58417 37537362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:25:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 10:25:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:25:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:25:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:25:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:25:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:25:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:25:53 [DEBUG   ] Finished updating board flags in 2.098 seconds
2018-10-26 10:25:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:26:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:26:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:26:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:26:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:26:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:26:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:26:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:26:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:26:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:26:53 [DEBUG   ] Finished updating board flags in 1.898 seconds
2018-10-26 10:26:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 10:27:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 10:27:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:27:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 10:27:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:27:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:27:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:27:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:27:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:27:53 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-26 10:27:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:28:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:28:32 [DEBUG   ] Got command RPT from MCS: ref #276304
2018-10-26 10:28:32 [DEBUG   ] summary = ERROR
2018-10-26 10:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276304  13 58417 37712021 A  ERRORERROR'
2018-10-26 10:28:32 [DEBUG   ] Got command RPT from MCS: ref #276305
2018-10-26 10:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276305  77 58417 37712225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:28:32 [DEBUG   ] Got command RPT from MCS: ref #276306
2018-10-26 10:28:32 [DEBUG   ] summary = ERROR
2018-10-26 10:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276306  13 58417 37712429 A  ERRORERROR'
2018-10-26 10:28:32 [DEBUG   ] Got command RPT from MCS: ref #276307
2018-10-26 10:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276307  77 58417 37712633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:28:32 [DEBUG   ] Got command RPT from MCS: ref #276308
2018-10-26 10:28:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276308  12 58417 37712825 A  ERRORB™™š'
2018-10-26 10:28:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 10:28:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:28:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 10:28:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:28:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:28:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:28:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:28:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:28:53 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-26 10:28:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:29:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:29:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:29:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:29:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:29:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:29:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:29:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:29:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:29:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 10:29:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 10:30:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:30:37 [DEBUG   ] Got command RPT from MCS: ref #276313
2018-10-26 10:30:37 [DEBUG   ] summary = ERROR
2018-10-26 10:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276313  13 58417 37837369 A  ERRORERROR'
2018-10-26 10:30:37 [DEBUG   ] Got command RPT from MCS: ref #276314
2018-10-26 10:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276314  77 58417 37837370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:30:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:30:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:30:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:30:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:30:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:30:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:30:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:30:53 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-26 10:30:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 10:31:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 10:31:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 10:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 10:31:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 10:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 10:31:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:31:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:31:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:31:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:31:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:31:53 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-26 10:31:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 10:32:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:32:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:32:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:32:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:32:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:32:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:32:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:32:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:32:53 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-26 10:32:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:33:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:33:32 [DEBUG   ] Got command RPT from MCS: ref #276336
2018-10-26 10:33:32 [DEBUG   ] summary = ERROR
2018-10-26 10:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276336  13 58417 38012105 A  ERRORERROR'
2018-10-26 10:33:32 [DEBUG   ] Got command RPT from MCS: ref #276337
2018-10-26 10:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276337  77 58417 38012309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:33:32 [DEBUG   ] Got command RPT from MCS: ref #276338
2018-10-26 10:33:32 [DEBUG   ] summary = ERROR
2018-10-26 10:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276338  13 58417 38012513 A  ERRORERROR'
2018-10-26 10:33:32 [DEBUG   ] Got command RPT from MCS: ref #276340
2018-10-26 10:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276340  77 58417 38012717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:33:32 [DEBUG   ] Got command RPT from MCS: ref #276342
2018-10-26 10:33:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276342  12 58417 38012909 A  ERRORB™™š'
2018-10-26 10:33:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:33:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:33:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:33:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:33:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:33:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:33:53 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-10-26 10:33:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 10:34:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:34:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:34:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:34:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:34:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:34:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:34:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:34:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:34:53 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-10-26 10:34:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:35:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:35:37 [DEBUG   ] Got command RPT from MCS: ref #276350
2018-10-26 10:35:37 [DEBUG   ] summary = ERROR
2018-10-26 10:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276350  13 58417 38137369 A  ERRORERROR'
2018-10-26 10:35:37 [DEBUG   ] Got command RPT from MCS: ref #276351
2018-10-26 10:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276351  77 58417 38137370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:35:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:35:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:35:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:35:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:35:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:35:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:35:53 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-26 10:35:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 10:36:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:36:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:36:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:36:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:36:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:36:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:36:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:36:53 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-26 10:36:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 10:37:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:37:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:37:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:37:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:37:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:37:53 [WARNING ] (13, 1, 'bot')
2018-10-26 10:37:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:37:53 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-26 10:37:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:38:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:38:32 [DEBUG   ] Got command RPT from MCS: ref #276371
2018-10-26 10:38:32 [DEBUG   ] summary = ERROR
2018-10-26 10:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276371  13 58417 38312201 A  ERRORERROR'
2018-10-26 10:38:32 [DEBUG   ] Got command RPT from MCS: ref #276372
2018-10-26 10:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276372  77 58417 38312393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:38:32 [DEBUG   ] Got command RPT from MCS: ref #276373
2018-10-26 10:38:32 [DEBUG   ] summary = ERROR
2018-10-26 10:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276373  13 58417 38312597 A  ERRORERROR'
2018-10-26 10:38:32 [DEBUG   ] Got command RPT from MCS: ref #276374
2018-10-26 10:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276374  77 58417 38312801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:38:33 [DEBUG   ] Got command RPT from MCS: ref #276375
2018-10-26 10:38:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276375  12 58417 38313005 A  ERRORB˜™š'
2018-10-26 10:38:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 10:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:38:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:38:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:38:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:38:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:38:54 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-10-26 10:38:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:39:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 10:39:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:39:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:39:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:39:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:39:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:39:54 [DEBUG   ] Finished updating board flags in 2.168 seconds
2018-10-26 10:39:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:40:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:40:37 [DEBUG   ] Got command RPT from MCS: ref #276376
2018-10-26 10:40:37 [DEBUG   ] summary = ERROR
2018-10-26 10:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276376  13 58417 38437365 A  ERRORERROR'
2018-10-26 10:40:37 [DEBUG   ] Got command RPT from MCS: ref #276377
2018-10-26 10:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276377  77 58417 38437366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:40:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:40:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:40:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:40:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:40:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:40:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:40:54 [DEBUG   ] Finished updating board flags in 2.111 seconds
2018-10-26 10:40:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:41:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:41:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:41:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:41:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:41:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:41:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:41:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:41:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:41:54 [DEBUG   ] Finished updating board flags in 1.917 seconds
2018-10-26 10:41:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:42:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:42:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 10:42:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:42:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:42:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:42:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:42:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:42:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:42:54 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 10:43:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 10:43:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 10:43:32 [DEBUG   ] Got command RPT from MCS: ref #276399
2018-10-26 10:43:32 [DEBUG   ] summary = ERROR
2018-10-26 10:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276399  13 58417 38612277 A  ERRORERROR'
2018-10-26 10:43:32 [DEBUG   ] Got command RPT from MCS: ref #276400
2018-10-26 10:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276400  77 58417 38612481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:43:32 [DEBUG   ] Got command RPT from MCS: ref #276401
2018-10-26 10:43:32 [DEBUG   ] summary = ERROR
2018-10-26 10:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276401  13 58417 38612685 A  ERRORERROR'
2018-10-26 10:43:32 [DEBUG   ] Got command RPT from MCS: ref #276403
2018-10-26 10:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276403  77 58417 38612877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:43:33 [DEBUG   ] Got command RPT from MCS: ref #276404
2018-10-26 10:43:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276404  12 58417 38613081 A  ERRORB—™š'
2018-10-26 10:43:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 10:43:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:43:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:43:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:43:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:43:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:43:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:43:54 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-26 10:44:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:44:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:44:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 10:44:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 10:44:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:44:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:44:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:44:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:44:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:44:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:44:54 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-26 10:45:00 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2018-10-26 10:45:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:45:37 [DEBUG   ] Got command RPT from MCS: ref #276413
2018-10-26 10:45:37 [DEBUG   ] summary = ERROR
2018-10-26 10:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276413  13 58417 38737361 A  ERRORERROR'
2018-10-26 10:45:37 [DEBUG   ] Got command RPT from MCS: ref #276414
2018-10-26 10:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276414  77 58417 38737362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:45:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:45:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:45:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:45:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:45:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:45:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:45:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:45:54 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-26 10:46:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 10:46:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 10:46:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 10:46:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:46:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:46:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:46:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:46:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:46:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:46:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:46:54 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-26 10:47:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 10:47:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 10:47:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 10:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:47:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:47:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:47:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:47:54 [WARNING ] (13, 1, 'bot')
2018-10-26 10:47:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 10:47:54 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-26 10:48:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 10:48:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:48:32 [DEBUG   ] Got command RPT from MCS: ref #276434
2018-10-26 10:48:32 [DEBUG   ] summary = ERROR
2018-10-26 10:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276434  13 58417 38912369 A  ERRORERROR'
2018-10-26 10:48:32 [DEBUG   ] Got command RPT from MCS: ref #276435
2018-10-26 10:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276435  77 58417 38912561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:48:32 [DEBUG   ] Got command RPT from MCS: ref #276436
2018-10-26 10:48:32 [DEBUG   ] summary = ERROR
2018-10-26 10:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276436  13 58417 38912765 A  ERRORERROR'
2018-10-26 10:48:32 [DEBUG   ] Got command RPT from MCS: ref #276437
2018-10-26 10:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276437  77 58417 38912969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:48:33 [DEBUG   ] Got command RPT from MCS: ref #276438
2018-10-26 10:48:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276438  12 58417 38913173 A  ERRORB˜™š'
2018-10-26 10:48:41 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 10:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2018-10-26 10:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:48:55 [WARNING ] (7, 1, 'top')
2018-10-26 10:48:55 [WARNING ] (7, 1, 'top')
2018-10-26 10:48:55 [WARNING ] (7, 1, 'top')
2018-10-26 10:48:55 [WARNING ] (7, 1, 'top')
2018-10-26 10:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:48:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:48:55 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-10-26 10:49:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:49:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:49:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 10:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 10:49:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:49:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:49:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:49:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:49:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:49:55 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-10-26 10:50:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:50:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 10:50:37 [DEBUG   ] Got command RPT from MCS: ref #276443
2018-10-26 10:50:37 [DEBUG   ] summary = ERROR
2018-10-26 10:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276443  13 58417 39037361 A  ERRORERROR'
2018-10-26 10:50:37 [DEBUG   ] Got command RPT from MCS: ref #276444
2018-10-26 10:50:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276444  84 58417 39037362 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:50:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 10:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 10:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:50:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:50:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:50:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:50:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:50:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:50:55 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-26 10:51:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:51:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:51:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:51:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:51:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:51:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:51:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:51:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:51:55 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-26 10:52:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:52:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:52:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 10:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:52:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:52:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:52:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:52:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:52:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:52:55 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-26 10:53:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 10:53:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 10:53:32 [DEBUG   ] Got command RPT from MCS: ref #276466
2018-10-26 10:53:32 [DEBUG   ] summary = ERROR
2018-10-26 10:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276466  13 58417 39212453 A  ERRORERROR'
2018-10-26 10:53:32 [DEBUG   ] Got command RPT from MCS: ref #276467
2018-10-26 10:53:32 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276467  84 58417 39212657 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:53:32 [DEBUG   ] Got command RPT from MCS: ref #276468
2018-10-26 10:53:32 [DEBUG   ] summary = ERROR
2018-10-26 10:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276468  13 58417 39212861 A  ERRORERROR'
2018-10-26 10:53:33 [DEBUG   ] Got command RPT from MCS: ref #276470
2018-10-26 10:53:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276470  84 58417 39213054 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:53:33 [DEBUG   ] Got command RPT from MCS: ref #276471
2018-10-26 10:53:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276471  12 58417 39213257 A  ERRORB˜™š'
2018-10-26 10:53:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 10:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:53:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:53:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:53:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:53:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:53:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:53:55 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-26 10:54:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:54:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 10:54:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 10:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:54:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:54:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:54:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:54:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:54:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:54:55 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-10-26 10:55:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 10:55:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 10:55:37 [DEBUG   ] Got command RPT from MCS: ref #276476
2018-10-26 10:55:37 [DEBUG   ] summary = ERROR
2018-10-26 10:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276476  13 58417 39337373 A  ERRORERROR'
2018-10-26 10:55:37 [DEBUG   ] Got command RPT from MCS: ref #276477
2018-10-26 10:55:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276477  84 58417 39337374 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:55:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 10:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:55:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:55:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:55:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:55:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:55:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:55:55 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-10-26 10:56:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 10:56:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 10:56:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 10:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 10:56:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:56:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:56:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:56:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:56:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:56:55 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-26 10:57:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 10:57:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 10:57:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:57:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:57:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:57:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:57:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:57:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:57:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:57:55 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-26 10:58:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:58:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:58:32 [DEBUG   ] Got command RPT from MCS: ref #276497
2018-10-26 10:58:32 [DEBUG   ] summary = ERROR
2018-10-26 10:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276497  13 58417 39512545 A  ERRORERROR'
2018-10-26 10:58:32 [DEBUG   ] Got command RPT from MCS: ref #276498
2018-10-26 10:58:32 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276498  84 58417 39512737 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:58:32 [DEBUG   ] Got command RPT from MCS: ref #276499
2018-10-26 10:58:32 [DEBUG   ] summary = ERROR
2018-10-26 10:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276499  13 58417 39512941 A  ERRORERROR'
2018-10-26 10:58:33 [DEBUG   ] Got command RPT from MCS: ref #276500
2018-10-26 10:58:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 10:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276500  84 58417 39513145 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 10:58:33 [DEBUG   ] Got command RPT from MCS: ref #276501
2018-10-26 10:58:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 10:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276501  12 58417 39513349 A  ERRORB˜™š'
2018-10-26 10:58:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 10:58:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:58:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:58:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:58:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:58:55 [WARNING ] (13, 1, 'bot')
2018-10-26 10:58:55 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:58:55 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-26 10:59:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 10:59:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 10:59:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 10:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 10:59:56 [WARNING ] (13, 1, 'bot')
2018-10-26 10:59:56 [WARNING ] (13, 1, 'bot')
2018-10-26 10:59:56 [WARNING ] (13, 1, 'bot')
2018-10-26 10:59:56 [WARNING ] (13, 1, 'bot')
2018-10-26 10:59:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 10:59:56 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-10-26 11:00:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 11:00:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 11:00:37 [DEBUG   ] Got command RPT from MCS: ref #276506
2018-10-26 11:00:37 [DEBUG   ] summary = ERROR
2018-10-26 11:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276506  13 58417 39637369 A  ERRORERROR'
2018-10-26 11:00:37 [DEBUG   ] Got command RPT from MCS: ref #276507
2018-10-26 11:00:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276507  84 58417 39637370 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:00:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:00:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:00:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:00:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:00:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:00:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:00:56 [DEBUG   ] Finished updating board flags in 2.226 seconds
2018-10-26 11:01:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:01:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 11:01:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 11:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 11:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:01:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:01:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:01:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:01:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:01:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:01:56 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-10-26 11:02:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:02:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:02:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 11:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 11:02:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:02:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:02:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:02:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:02:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:02:56 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-26 11:03:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 11:03:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 11:03:32 [DEBUG   ] Got command RPT from MCS: ref #276529
2018-10-26 11:03:32 [DEBUG   ] summary = ERROR
2018-10-26 11:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276529  13 58417 39812629 A  ERRORERROR'
2018-10-26 11:03:32 [DEBUG   ] Got command RPT from MCS: ref #276530
2018-10-26 11:03:32 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276530  84 58417 39812833 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:03:33 [DEBUG   ] Got command RPT from MCS: ref #276531
2018-10-26 11:03:33 [DEBUG   ] summary = ERROR
2018-10-26 11:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276531  13 58417 39813026 A  ERRORERROR'
2018-10-26 11:03:33 [DEBUG   ] Got command RPT from MCS: ref #276533
2018-10-26 11:03:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276533  84 58417 39813229 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:03:33 [DEBUG   ] Got command RPT from MCS: ref #276535
2018-10-26 11:03:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276535  12 58417 39813433 A  ERRORB™™š'
2018-10-26 11:03:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 11:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:03:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:03:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:03:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:03:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:03:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:03:56 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-26 11:04:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 11:04:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:04:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 11:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:04:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:04:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:04:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:04:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:04:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:04:56 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-26 11:05:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:05:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:05:37 [DEBUG   ] Got command RPT from MCS: ref #276543
2018-10-26 11:05:37 [DEBUG   ] summary = ERROR
2018-10-26 11:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276543  13 58417 39937373 A  ERRORERROR'
2018-10-26 11:05:37 [DEBUG   ] Got command RPT from MCS: ref #276544
2018-10-26 11:05:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276544  84 58417 39937374 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:05:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:05:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:05:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:05:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:05:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:05:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:05:56 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 11:06:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 11:06:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 11:06:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:06:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:06:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:06:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:06:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:06:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:06:56 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-26 11:07:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:07:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:07:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 11:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:07:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:07:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:07:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:07:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:07:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:07:56 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-10-26 11:08:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:08:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:08:32 [DEBUG   ] Got command RPT from MCS: ref #276564
2018-10-26 11:08:32 [DEBUG   ] summary = ERROR
2018-10-26 11:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276564  13 58417 40112713 A  ERRORERROR'
2018-10-26 11:08:32 [DEBUG   ] Got command RPT from MCS: ref #276565
2018-10-26 11:08:32 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276565  84 58417 40112917 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:08:33 [DEBUG   ] Got command RPT from MCS: ref #276566
2018-10-26 11:08:33 [DEBUG   ] summary = ERROR
2018-10-26 11:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276566  13 58417 40113121 A  ERRORERROR'
2018-10-26 11:08:33 [DEBUG   ] Got command RPT from MCS: ref #276567
2018-10-26 11:08:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276567  84 58417 40113313 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:08:33 [DEBUG   ] Got command RPT from MCS: ref #276568
2018-10-26 11:08:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276568  12 58417 40113517 A  ERRORB˜™š'
2018-10-26 11:08:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:08:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:08:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:08:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:08:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:08:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:08:56 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-26 11:09:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:09:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:09:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:09:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:09:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:09:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:09:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:09:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:09:56 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-26 11:10:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:10:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 11:10:37 [DEBUG   ] Got command RPT from MCS: ref #276569
2018-10-26 11:10:37 [DEBUG   ] summary = ERROR
2018-10-26 11:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276569  13 58417 40237369 A  ERRORERROR'
2018-10-26 11:10:37 [DEBUG   ] Got command RPT from MCS: ref #276570
2018-10-26 11:10:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276570  84 58417 40237370 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:10:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:10:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:10:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:10:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:10:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:10:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:10:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:10:56 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-26 11:11:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:11:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:11:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 11:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:11:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:11:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:11:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:11:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:11:56 [WARNING ] (13, 1, 'bot')
2018-10-26 11:11:56 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:11:56 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-26 11:12:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:12:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:12:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 11:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 11:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:12:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:12:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:12:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:12:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:12:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:12:57 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-10-26 11:13:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 11:13:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:13:32 [DEBUG   ] Got command RPT from MCS: ref #276592
2018-10-26 11:13:32 [DEBUG   ] summary = ERROR
2018-10-26 11:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276592  13 58417 40412797 A  ERRORERROR'
2018-10-26 11:13:33 [DEBUG   ] Got command RPT from MCS: ref #276593
2018-10-26 11:13:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276593  84 58417 40413001 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:13:33 [DEBUG   ] Got command RPT from MCS: ref #276594
2018-10-26 11:13:33 [DEBUG   ] summary = ERROR
2018-10-26 11:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276594  13 58417 40413205 A  ERRORERROR'
2018-10-26 11:13:33 [DEBUG   ] Got command RPT from MCS: ref #276596
2018-10-26 11:13:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276596  84 58417 40413397 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:13:33 [DEBUG   ] Got command RPT from MCS: ref #276597
2018-10-26 11:13:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276597  12 58417 40413601 A  ERRORB˜™š'
2018-10-26 11:13:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:13:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:13:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:13:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:13:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:13:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:13:57 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-10-26 11:14:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:14:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 11:14:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 11:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 11:14:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:14:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:14:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:14:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:14:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:14:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:14:57 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-26 11:15:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 11:15:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 11:15:37 [DEBUG   ] Got command RPT from MCS: ref #276606
2018-10-26 11:15:37 [DEBUG   ] summary = ERROR
2018-10-26 11:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276606  13 58417 40537377 A  ERRORERROR'
2018-10-26 11:15:37 [DEBUG   ] Got command RPT from MCS: ref #276607
2018-10-26 11:15:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276607  84 58417 40537378 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:15:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:15:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:15:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:15:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:15:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:15:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:15:57 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-26 11:16:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 11:16:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 11:16:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:16:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:16:57 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-10-26 11:17:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:17:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:17:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:17:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:17:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:17:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:17:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:17:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:17:57 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-26 11:18:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:18:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:18:32 [DEBUG   ] Got command RPT from MCS: ref #276627
2018-10-26 11:18:32 [DEBUG   ] summary = ERROR
2018-10-26 11:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276627  13 58417 40712885 A  ERRORERROR'
2018-10-26 11:18:33 [DEBUG   ] Got command RPT from MCS: ref #276628
2018-10-26 11:18:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276628  84 58417 40713089 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:18:33 [DEBUG   ] Got command RPT from MCS: ref #276629
2018-10-26 11:18:33 [DEBUG   ] summary = ERROR
2018-10-26 11:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276629  13 58417 40713281 A  ERRORERROR'
2018-10-26 11:18:33 [DEBUG   ] Got command RPT from MCS: ref #276630
2018-10-26 11:18:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276630  84 58417 40713485 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:18:33 [DEBUG   ] Got command RPT from MCS: ref #276631
2018-10-26 11:18:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276631  12 58417 40713689 A  ERRORB™™š'
2018-10-26 11:18:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:18:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:18:57 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-26 11:19:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:19:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:19:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:19:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:19:57 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-10-26 11:20:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:20:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:20:37 [DEBUG   ] Got command RPT from MCS: ref #276636
2018-10-26 11:20:37 [DEBUG   ] summary = ERROR
2018-10-26 11:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276636  13 58417 40837377 A  ERRORERROR'
2018-10-26 11:20:37 [DEBUG   ] Got command RPT from MCS: ref #276637
2018-10-26 11:20:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276637  84 58417 40837378 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:20:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:20:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:20:57 [DEBUG   ] Finished updating board flags in 1.706 seconds
2018-10-26 11:21:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:21:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:21:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:21:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:21:57 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-26 11:22:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:22:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:22:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:22:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:22:57 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-26 11:23:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:23:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 11:23:32 [DEBUG   ] Got command RPT from MCS: ref #276659
2018-10-26 11:23:32 [DEBUG   ] summary = ERROR
2018-10-26 11:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276659  13 58417 41012965 A  ERRORERROR'
2018-10-26 11:23:33 [DEBUG   ] Got command RPT from MCS: ref #276660
2018-10-26 11:23:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276660  84 58417 41013169 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:23:33 [DEBUG   ] Got command RPT from MCS: ref #276661
2018-10-26 11:23:33 [DEBUG   ] summary = ERROR
2018-10-26 11:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276661  13 58417 41013373 A  ERRORERROR'
2018-10-26 11:23:33 [DEBUG   ] Got command RPT from MCS: ref #276663
2018-10-26 11:23:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276663  84 58417 41013565 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:23:33 [DEBUG   ] Got command RPT from MCS: ref #276664
2018-10-26 11:23:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276664  12 58417 41013769 A  ERRORB˜™š'
2018-10-26 11:23:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:23:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:23:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:23:57 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-10-26 11:24:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:24:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:24:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 11:24:57 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:24:57 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-10-26 11:25:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 11:25:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:25:37 [DEBUG   ] Got command RPT from MCS: ref #276669
2018-10-26 11:25:37 [DEBUG   ] summary = ERROR
2018-10-26 11:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276669  13 58417 41137373 A  ERRORERROR'
2018-10-26 11:25:37 [DEBUG   ] Got command RPT from MCS: ref #276670
2018-10-26 11:25:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276670  84 58417 41137374 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:25:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 11:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:25:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:25:58 [DEBUG   ] Finished updating board flags in 2.136 seconds
2018-10-26 11:26:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 11:26:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 11:26:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 11:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:26:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:26:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:26:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:26:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:26:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:26:58 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-10-26 11:27:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:27:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 11:27:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 11:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:27:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:27:58 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-26 11:28:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 11:28:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 11:28:33 [DEBUG   ] Got command RPT from MCS: ref #276690
2018-10-26 11:28:33 [DEBUG   ] summary = ERROR
2018-10-26 11:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276690  13 58417 41313053 A  ERRORERROR'
2018-10-26 11:28:33 [DEBUG   ] Got command RPT from MCS: ref #276691
2018-10-26 11:28:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276691  84 58417 41313257 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:28:33 [DEBUG   ] Got command RPT from MCS: ref #276692
2018-10-26 11:28:33 [DEBUG   ] summary = ERROR
2018-10-26 11:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276692  13 58417 41313461 A  ERRORERROR'
2018-10-26 11:28:33 [DEBUG   ] Got command RPT from MCS: ref #276693
2018-10-26 11:28:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276693  84 58417 41313653 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:28:33 [DEBUG   ] Got command RPT from MCS: ref #276694
2018-10-26 11:28:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276694  12 58417 41313857 A  ERRORB˜™š'
2018-10-26 11:28:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 11:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 11:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:28:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:28:58 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-26 11:29:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:29:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:29:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 11:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:29:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:29:58 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-26 11:30:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:30:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:30:37 [DEBUG   ] Got command RPT from MCS: ref #276699
2018-10-26 11:30:37 [DEBUG   ] summary = ERROR
2018-10-26 11:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276699  13 58417 41437377 A  ERRORERROR'
2018-10-26 11:30:37 [DEBUG   ] Got command RPT from MCS: ref #276700
2018-10-26 11:30:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276700  84 58417 41437378 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:30:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:30:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:30:58 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-10-26 11:31:05 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 11:31:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:31:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 11:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 11:31:58 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:31:58 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-26 11:32:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:32:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 11:32:46 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-26 11:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:32:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:32:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:32:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:32:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:32:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:32:59 [DEBUG   ] Finished updating board flags in 2.114 seconds
2018-10-26 11:33:06 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 11:33:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 11:33:33 [DEBUG   ] Got command RPT from MCS: ref #276722
2018-10-26 11:33:33 [DEBUG   ] summary = ERROR
2018-10-26 11:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276722  13 58417 41613141 A  ERRORERROR'
2018-10-26 11:33:33 [DEBUG   ] Got command RPT from MCS: ref #276723
2018-10-26 11:33:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276723  84 58417 41613345 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:33:33 [DEBUG   ] Got command RPT from MCS: ref #276724
2018-10-26 11:33:33 [DEBUG   ] summary = ERROR
2018-10-26 11:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276724  13 58417 41613537 A  ERRORERROR'
2018-10-26 11:33:33 [DEBUG   ] Got command RPT from MCS: ref #276726
2018-10-26 11:33:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276726  84 58417 41613741 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:33:33 [DEBUG   ] Got command RPT from MCS: ref #276727
2018-10-26 11:33:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276727  12 58417 41613945 A  ERRORB™™š'
2018-10-26 11:33:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:33:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:33:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:33:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:33:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:33:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:33:59 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-26 11:34:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 11:34:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 11:34:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 11:34:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 11:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:34:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:34:59 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-26 11:35:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:35:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:35:37 [DEBUG   ] Got command RPT from MCS: ref #276736
2018-10-26 11:35:37 [DEBUG   ] summary = ERROR
2018-10-26 11:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276736  13 58417 41737377 A  ERRORERROR'
2018-10-26 11:35:37 [DEBUG   ] Got command RPT from MCS: ref #276737
2018-10-26 11:35:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276737  84 58417 41737378 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:35:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 11:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:35:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:35:59 [DEBUG   ] Finished updating board flags in 1.852 seconds
2018-10-26 11:36:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:36:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:36:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:36:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:36:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:36:59 [DEBUG   ] Finished updating board flags in 1.734 seconds
2018-10-26 11:37:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:37:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:37:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:37:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:37:59 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-26 11:38:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:38:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 11:38:33 [DEBUG   ] Got command RPT from MCS: ref #276757
2018-10-26 11:38:33 [DEBUG   ] summary = ERROR
2018-10-26 11:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276757  13 58417 41913217 A  ERRORERROR'
2018-10-26 11:38:33 [DEBUG   ] Got command RPT from MCS: ref #276758
2018-10-26 11:38:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276758  84 58417 41913421 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:38:33 [DEBUG   ] Got command RPT from MCS: ref #276759
2018-10-26 11:38:33 [DEBUG   ] summary = ERROR
2018-10-26 11:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276759  13 58417 41913625 A  ERRORERROR'
2018-10-26 11:38:33 [DEBUG   ] Got command RPT from MCS: ref #276760
2018-10-26 11:38:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276760  84 58417 41913829 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:38:34 [DEBUG   ] Got command RPT from MCS: ref #276761
2018-10-26 11:38:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276761  12 58417 41914021 A  ERRORB˜™š'
2018-10-26 11:38:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 11:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:38:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:38:59 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-26 11:39:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:39:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:39:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 11:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:39:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:39:59 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 11:40:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 11:40:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #276762
2018-10-26 11:40:37 [DEBUG   ] summary = ERROR
2018-10-26 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276762  13 58417 42037377 A  ERRORERROR'
2018-10-26 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #276763
2018-10-26 11:40:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276763  84 58417 42037378 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:40:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 11:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 11:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 11:40:59 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:40:59 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-10-26 11:41:07 [DEBUG   ] Finished updating ant stats in 1.014 seconds
2018-10-26 11:41:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:41:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:42:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:42:00 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-10-26 11:42:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 11:42:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:42:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 11:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:43:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:43:00 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-26 11:43:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:43:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:43:33 [DEBUG   ] Got command RPT from MCS: ref #276785
2018-10-26 11:43:33 [DEBUG   ] summary = ERROR
2018-10-26 11:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276785  13 58417 42213305 A  ERRORERROR'
2018-10-26 11:43:33 [DEBUG   ] Got command RPT from MCS: ref #276786
2018-10-26 11:43:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276786  84 58417 42213509 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:43:33 [DEBUG   ] Got command RPT from MCS: ref #276787
2018-10-26 11:43:33 [DEBUG   ] summary = ERROR
2018-10-26 11:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276787  13 58417 42213713 A  ERRORERROR'
2018-10-26 11:43:33 [DEBUG   ] Got command RPT from MCS: ref #276788
2018-10-26 11:43:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276788  84 58417 42213905 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:43:34 [DEBUG   ] Got command RPT from MCS: ref #276790
2018-10-26 11:43:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276790  12 58417 42214109 A  ERRORB™™š'
2018-10-26 11:43:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:44:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:44:00 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-26 11:44:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:44:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:44:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 11:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 11:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:45:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:45:00 [DEBUG   ] Finished updating board flags in 1.864 seconds
2018-10-26 11:45:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:45:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #276799
2018-10-26 11:45:37 [DEBUG   ] summary = ERROR
2018-10-26 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276799  13 58417 42337381 A  ERRORERROR'
2018-10-26 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #276800
2018-10-26 11:45:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276800  84 58417 42337382 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:45:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:46:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:46:00 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-10-26 11:46:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 11:46:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:46:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:47:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:47:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:47:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:47:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:47:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:47:00 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-10-26 11:47:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 11:47:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 11:47:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:48:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:48:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:48:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:48:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:48:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:48:00 [DEBUG   ] Finished updating board flags in 1.642 seconds
2018-10-26 11:48:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:48:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:48:33 [DEBUG   ] Got command RPT from MCS: ref #276820
2018-10-26 11:48:33 [DEBUG   ] summary = ERROR
2018-10-26 11:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276820  13 58417 42513393 A  ERRORERROR'
2018-10-26 11:48:33 [DEBUG   ] Got command RPT from MCS: ref #276821
2018-10-26 11:48:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276821  84 58417 42513585 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:48:33 [DEBUG   ] Got command RPT from MCS: ref #276822
2018-10-26 11:48:33 [DEBUG   ] summary = ERROR
2018-10-26 11:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276822  13 58417 42513789 A  ERRORERROR'
2018-10-26 11:48:33 [DEBUG   ] Got command RPT from MCS: ref #276823
2018-10-26 11:48:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276823  84 58417 42513993 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:48:34 [DEBUG   ] Got command RPT from MCS: ref #276824
2018-10-26 11:48:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276824  12 58417 42514197 A  ERRORB™™š'
2018-10-26 11:48:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 11:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:49:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:49:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:49:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:49:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:49:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:49:00 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-26 11:49:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 11:49:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 11:49:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 11:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:50:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:50:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:50:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:50:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:50:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:50:00 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-10-26 11:50:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:50:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #276829
2018-10-26 11:50:37 [DEBUG   ] summary = ERROR
2018-10-26 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276829  13 58417 42637389 A  ERRORERROR'
2018-10-26 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #276830
2018-10-26 11:50:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276830  84 58417 42637390 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:50:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 11:50:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 11:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:51:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:51:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:51:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:51:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:51:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:51:00 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 11:51:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 11:51:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:51:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:52:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:52:00 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-26 11:52:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:52:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:52:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 11:53:00 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:53:00 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-26 11:53:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:53:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:53:33 [DEBUG   ] Got command RPT from MCS: ref #276852
2018-10-26 11:53:33 [DEBUG   ] summary = ERROR
2018-10-26 11:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276852  13 58417 42813481 A  ERRORERROR'
2018-10-26 11:53:33 [DEBUG   ] Got command RPT from MCS: ref #276853
2018-10-26 11:53:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276853  84 58417 42813673 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:53:33 [DEBUG   ] Got command RPT from MCS: ref #276854
2018-10-26 11:53:33 [DEBUG   ] summary = ERROR
2018-10-26 11:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276854  13 58417 42813877 A  ERRORERROR'
2018-10-26 11:53:34 [DEBUG   ] Got command RPT from MCS: ref #276856
2018-10-26 11:53:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276856  84 58417 42814081 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:53:34 [DEBUG   ] Got command RPT from MCS: ref #276857
2018-10-26 11:53:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276857  12 58417 42814273 A  ERRORB˜™š'
2018-10-26 11:53:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 11:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:54:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:54:01 [DEBUG   ] Finished updating board flags in 2.125 seconds
2018-10-26 11:54:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 11:54:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 11:54:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 11:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:55:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:55:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:55:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:55:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:55:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:55:01 [DEBUG   ] Finished updating board flags in 1.893 seconds
2018-10-26 11:55:08 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-26 11:55:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #276862
2018-10-26 11:55:37 [DEBUG   ] summary = ERROR
2018-10-26 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276862  13 58417 42937385 A  ERRORERROR'
2018-10-26 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #276863
2018-10-26 11:55:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276863  84 58417 42937386 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:55:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 11:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 11:56:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 11:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:56:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:56:01 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-26 11:56:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 11:56:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 11:56:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 11:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:57:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:57:01 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-26 11:57:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 11:57:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 11:57:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 11:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:58:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:58:01 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-26 11:58:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 11:58:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 11:58:33 [DEBUG   ] Got command RPT from MCS: ref #276883
2018-10-26 11:58:33 [DEBUG   ] summary = ERROR
2018-10-26 11:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276883  13 58417 43113561 A  ERRORERROR'
2018-10-26 11:58:33 [DEBUG   ] Got command RPT from MCS: ref #276884
2018-10-26 11:58:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276884  84 58417 43113765 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:58:33 [DEBUG   ] Got command RPT from MCS: ref #276885
2018-10-26 11:58:33 [DEBUG   ] summary = ERROR
2018-10-26 11:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276885  13 58417 43113958 A  ERRORERROR'
2018-10-26 11:58:34 [DEBUG   ] Got command RPT from MCS: ref #276886
2018-10-26 11:58:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 11:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276886  84 58417 43114161 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 11:58:34 [DEBUG   ] Got command RPT from MCS: ref #276887
2018-10-26 11:58:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 11:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276887  12 58417 43114365 A  ERRORB™™š'
2018-10-26 11:58:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 11:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 11:59:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 11:59:01 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-26 11:59:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 11:59:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 11:59:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:00:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:00:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:00:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:00:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:00:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:00:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:00:01 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-26 12:00:09 [DEBUG   ] Finished updating ant stats in 0.981 seconds
2018-10-26 12:00:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #276892
2018-10-26 12:00:37 [DEBUG   ] summary = ERROR
2018-10-26 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276892  13 58417 43237381 A  ERRORERROR'
2018-10-26 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #276893
2018-10-26 12:00:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276893  84 58417 43237382 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:00:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:01:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:01:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:01:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:01:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:01:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:01:01 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 12:01:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:01:29 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 12:01:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:02:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:02:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:02:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:02:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:02:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:02:01 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 12:02:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 12:02:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:02:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 12:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:03:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:03:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:03:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:03:01 [WARNING ] (13, 1, 'bot')
2018-10-26 12:03:01 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:03:01 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-10-26 12:03:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 12:03:29 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-10-26 12:03:33 [DEBUG   ] Got command RPT from MCS: ref #276915
2018-10-26 12:03:33 [DEBUG   ] summary = ERROR
2018-10-26 12:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276915  13 58417 43413649 A  ERRORERROR'
2018-10-26 12:03:33 [DEBUG   ] Got command RPT from MCS: ref #276916
2018-10-26 12:03:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276916  84 58417 43413841 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:03:34 [DEBUG   ] Got command RPT from MCS: ref #276917
2018-10-26 12:03:34 [DEBUG   ] summary = ERROR
2018-10-26 12:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276917  13 58417 43414045 A  ERRORERROR'
2018-10-26 12:03:34 [DEBUG   ] Got command RPT from MCS: ref #276919
2018-10-26 12:03:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276919  84 58417 43414249 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:03:34 [DEBUG   ] Got command RPT from MCS: ref #276920
2018-10-26 12:03:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276920  12 58417 43414453 A  ERRORB™™š'
2018-10-26 12:03:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 12:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:04:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:04:02 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-10-26 12:04:10 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 12:04:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 12:04:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 12:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:05:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:05:02 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-26 12:05:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:05:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #276929
2018-10-26 12:05:37 [DEBUG   ] summary = ERROR
2018-10-26 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276929  13 58417 43537393 A  ERRORERROR'
2018-10-26 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #276930
2018-10-26 12:05:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276930  84 58417 43537394 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:05:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 12:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:06:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:06:02 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-26 12:06:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 12:06:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:06:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:07:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:07:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:07:02 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-26 12:07:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 12:07:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 12:07:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:08:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:08:02 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-26 12:08:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:08:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:08:33 [DEBUG   ] Got command RPT from MCS: ref #276950
2018-10-26 12:08:33 [DEBUG   ] summary = ERROR
2018-10-26 12:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276950  13 58417 43713733 A  ERRORERROR'
2018-10-26 12:08:33 [DEBUG   ] Got command RPT from MCS: ref #276951
2018-10-26 12:08:33 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276951  84 58417 43713937 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:08:34 [DEBUG   ] Got command RPT from MCS: ref #276952
2018-10-26 12:08:34 [DEBUG   ] summary = ERROR
2018-10-26 12:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276952  13 58417 43714129 A  ERRORERROR'
2018-10-26 12:08:34 [DEBUG   ] Got command RPT from MCS: ref #276953
2018-10-26 12:08:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276953  84 58417 43714333 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:08:34 [DEBUG   ] Got command RPT from MCS: ref #276954
2018-10-26 12:08:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276954  12 58417 43714537 A  ERRORB˜™š'
2018-10-26 12:08:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 12:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:09:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:09:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:09:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:09:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:09:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:09:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:09:02 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-26 12:09:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 12:09:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 12:09:50 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-10-26 12:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 12:10:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:10:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:10:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:10:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:10:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:10:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:10:02 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 12:10:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 12:10:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #276955
2018-10-26 12:10:37 [DEBUG   ] summary = ERROR
2018-10-26 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276955  13 58417 43837385 A  ERRORERROR'
2018-10-26 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #276956
2018-10-26 12:10:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276956  84 58417 43837386 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:10:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 12:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:11:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:11:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:11:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:11:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:11:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:11:02 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-26 12:11:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 12:11:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 12:11:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 12:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 12:12:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:12:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:12:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:12:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:12:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:12:02 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-26 12:12:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 12:12:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 12:12:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 12:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:13:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:13:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:13:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:13:02 [WARNING ] (13, 1, 'bot')
2018-10-26 12:13:02 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:13:02 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-10-26 12:13:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 12:13:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 12:13:33 [DEBUG   ] Got command RPT from MCS: ref #276978
2018-10-26 12:13:33 [DEBUG   ] summary = ERROR
2018-10-26 12:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276978  13 58417 44013813 A  ERRORERROR'
2018-10-26 12:13:34 [DEBUG   ] Got command RPT from MCS: ref #276979
2018-10-26 12:13:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276979  84 58417 44014017 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:13:34 [DEBUG   ] Got command RPT from MCS: ref #276980
2018-10-26 12:13:34 [DEBUG   ] summary = ERROR
2018-10-26 12:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276980  13 58417 44014221 A  ERRORERROR'
2018-10-26 12:13:34 [DEBUG   ] Got command RPT from MCS: ref #276982
2018-10-26 12:13:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276982  84 58417 44014413 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:13:34 [DEBUG   ] Got command RPT from MCS: ref #276984
2018-10-26 12:13:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276984  12 58417 44014617 A  ERRORB™™š'
2018-10-26 12:13:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 12:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:14:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:14:03 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-10-26 12:14:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:14:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:14:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:15:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:15:03 [DEBUG   ] Finished updating board flags in 2.149 seconds
2018-10-26 12:15:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:15:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #276992
2018-10-26 12:15:37 [DEBUG   ] summary = ERROR
2018-10-26 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276992  13 58417 44137393 A  ERRORERROR'
2018-10-26 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #276993
2018-10-26 12:15:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   276993  84 58417 44137394 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:15:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:16:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:16:03 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-10-26 12:16:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:16:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:16:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:17:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:17:03 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-10-26 12:17:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:17:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 12:17:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 12:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:18:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:18:03 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-10-26 12:18:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:18:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:18:33 [DEBUG   ] Got command RPT from MCS: ref #277013
2018-10-26 12:18:33 [DEBUG   ] summary = ERROR
2018-10-26 12:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277013  13 58417 44313897 A  ERRORERROR'
2018-10-26 12:18:34 [DEBUG   ] Got command RPT from MCS: ref #277014
2018-10-26 12:18:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277014  84 58417 44314101 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:18:34 [DEBUG   ] Got command RPT from MCS: ref #277015
2018-10-26 12:18:34 [DEBUG   ] summary = ERROR
2018-10-26 12:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277015  13 58417 44314305 A  ERRORERROR'
2018-10-26 12:18:34 [DEBUG   ] Got command RPT from MCS: ref #277016
2018-10-26 12:18:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277016  84 58417 44314509 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:18:34 [DEBUG   ] Got command RPT from MCS: ref #277017
2018-10-26 12:18:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277017  12 58417 44314701 A  ERRORB™™š'
2018-10-26 12:18:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:19:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:19:03 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-26 12:19:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:19:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:19:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:20:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:20:03 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-10-26 12:20:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 12:20:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #277022
2018-10-26 12:20:37 [DEBUG   ] summary = ERROR
2018-10-26 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277022  13 58417 44437393 A  ERRORERROR'
2018-10-26 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #277023
2018-10-26 12:20:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277023  84 58417 44437394 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:20:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 12:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:21:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:21:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:21:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:21:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:21:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:21:03 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-10-26 12:21:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 12:21:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 12:21:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:22:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:22:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:22:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:22:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:22:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:22:03 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-10-26 12:22:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:22:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:22:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:23:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:23:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:23:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:23:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:23:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:23:03 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-26 12:23:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:23:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:23:33 [DEBUG   ] Got command RPT from MCS: ref #277045
2018-10-26 12:23:33 [DEBUG   ] summary = ERROR
2018-10-26 12:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277045  13 58417 44613985 A  ERRORERROR'
2018-10-26 12:23:34 [DEBUG   ] Got command RPT from MCS: ref #277046
2018-10-26 12:23:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277046  84 58417 44614189 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:23:34 [DEBUG   ] Got command RPT from MCS: ref #277047
2018-10-26 12:23:34 [DEBUG   ] summary = ERROR
2018-10-26 12:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277047  13 58417 44614393 A  ERRORERROR'
2018-10-26 12:23:34 [DEBUG   ] Got command RPT from MCS: ref #277049
2018-10-26 12:23:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277049  84 58417 44614585 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:23:34 [DEBUG   ] Got command RPT from MCS: ref #277050
2018-10-26 12:23:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277050  12 58417 44614789 A  ERRORB™™š'
2018-10-26 12:23:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:24:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:24:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:24:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:24:03 [WARNING ] (13, 1, 'bot')
2018-10-26 12:24:03 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:24:03 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-26 12:24:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:24:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 12:24:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
